-- Logs begin at Tue 2022-08-30 01:11:21 UTC, end at Tue 2022-08-30 02:23:39 UTC. -- Aug 30 01:53:04.364955 dv-cinder-819667-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 01:53:04.373633 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 01:53:04 2022] *** Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: nodename: dv-cinder-819667-6-iscsi Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: machine: x86_64 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: clock source: unix Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: pcre jit disabled Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: detected number of CPU cores: 4 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: current working directory: / Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: detected binary path: /usr/bin/uwsgi-core Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: your processes number limit is 47680 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: your memory page size is 4096 bytes Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: detected max file descriptor number: 2048 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: lock engine: pthread robust mutexes Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: thunder lock: enabled Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 01:53:04.376246 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 01:53:04.415024 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: Python main interpreter initialized at 0x56063d8479c0 Aug 30 01:53:04.415024 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: python threads support enabled Aug 30 01:53:04.415024 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: your server socket listen backlog is limited to 100 connections Aug 30 01:53:04.415024 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: your mercy for graceful operations on workers is 90 seconds Aug 30 01:53:04.415367 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 01:53:04.415440 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: *** Operational MODE: preforking *** Aug 30 01:53:04.415690 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: *** uWSGI is running in multiple interpreter mode *** Aug 30 01:53:04.415690 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: spawned uWSGI master process (pid: 105871) Aug 30 01:53:04.415903 dv-cinder-819667-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 01:53:04.416956 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: spawned uWSGI worker 1 (pid: 105872, cores: 1) Aug 30 01:53:04.416956 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: spawned uWSGI worker 2 (pid: 105873, cores: 1) Aug 30 01:53:04.416956 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 01:53:05.074047 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:53:05.074666 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 01:53:06.168404 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:53:06.168404 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: from cryptography.utils import int_from_bytes Aug 30 01:53:06.169000 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:53:06.169000 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: from cryptography.utils import int_from_bytes Aug 30 01:53:06.174983 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:53:06.174983 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: from cryptography.utils import int_from_bytes Aug 30 01:53:06.175412 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 01:53:06.175412 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: from cryptography.utils import int_from_bytes Aug 30 01:53:08.641917 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:53:08.642485 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:53:08.642667 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:53:08.643022 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:53:08.643240 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 01:53:08.643602 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:53:08.643685 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 01:53:08.643773 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.643943 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.644036 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 01:53:08.644276 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.644978 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 01:53:08.645208 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.645383 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 01:53:08.645559 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.645648 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.645874 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646024 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646190 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646298 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646504 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646599 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646824 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.646927 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.647078 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.647172 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.647386 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.647493 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.647704 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-6-iscsi {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.647812 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648022 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648115 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648324 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648417 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648628 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648729 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.648937 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649038 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-6-iscsi {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649233 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649332 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649570 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649666 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649869 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.649964 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.650184 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.650360 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.650490 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.651560 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.651656 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.651732 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.651808 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.651875 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.651953 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652041 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652108 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652178 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652244 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652325 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652521 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652620 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652797 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.652897 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.653106 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.653201 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.653412 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.653542 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.653754 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.653853 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-6-iscsi {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.654060 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.654146 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.654379 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.654474 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.654688 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.654774 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.655089 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-6-iscsi {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.655173 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.655396 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.655492 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.655697 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.655800 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656006 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656090 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656329 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656413 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656631 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656726 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.656949 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.657044 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.657261 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.657388 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.657597 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.657684 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.657917 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658010 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658214 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658299 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658519 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658612 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658822 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.658916 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.659136 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.659227 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.659436 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.659531 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.659732 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.659818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660007 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660183 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660320 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660550 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660637 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660891 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.660983 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.661200 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.661285 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.661445 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.661563 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.661712 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.661805 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662024 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662119 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662336 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662429 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662640 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662725 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.662942 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663034 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663191 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663277 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663513 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663598 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663815 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.663907 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.664119 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.664245 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.664420 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.664529 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.664752 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.664845 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.665066 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.665181 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.665372 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.665499 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.665704 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.665796 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666018 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666119 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666311 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666414 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666628 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666723 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.666928 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667018 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667230 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667332 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667540 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667630 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667863 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.667964 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.668165 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.668273 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.668479 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.668571 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.668792 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.668881 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.669092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.669188 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.669392 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.669504 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.669718 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.669823 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670032 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670121 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670358 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670452 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670658 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670749 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670912 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.670994 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.671209 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.671313 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.671562 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.671655 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.671878 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.671964 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.672180 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.672270 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.672429 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.672520 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.672731 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.672816 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673035 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673121 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673334 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673425 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673660 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673748 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.673960 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674044 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674260 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674353 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674559 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674643 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674853 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.674944 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.675151 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.675245 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.675448 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.675533 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.675773 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.675857 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.676101 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.676194 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.676470 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.676562 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.676773 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.676856 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.677074 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.677165 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.677371 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.677522 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.677697 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.677783 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678019 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678104 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678318 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678415 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678620 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678715 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.678922 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679009 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679220 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679305 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679519 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679604 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679829 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.679913 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.680128 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.680211 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.680428 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.680514 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.680734 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.680818 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681027 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681119 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681329 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681421 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681663 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681758 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.681962 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682048 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682263 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682358 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682557 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682643 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682853 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.682937 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.683151 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.683245 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.683447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.683539 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.683741 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.683827 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684037 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684134 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684333 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684418 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684633 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684724 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.684937 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685034 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685238 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685322 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685561 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685661 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685861 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.685953 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.686169 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.686261 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.686579 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.686685 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.686795 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.686889 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.687106 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.687254 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.687408 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.687485 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.687728 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 01:53:08.687807 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.688061 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.688146 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.688392 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.688477 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.688719 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.688809 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689028 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689114 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689350 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689436 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689681 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689843 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.689988 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.690077 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.690295 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.690394 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.690608 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.690700 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.690918 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.691008 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.691968 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692083 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692083 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692229 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692379 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692551 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692692 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692786 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.692996 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.693083 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.693308 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.693401 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.693656 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.693753 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.693970 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.694057 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.694276 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.694370 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.694611 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.694705 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.694947 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695033 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695253 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695339 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695570 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695664 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695881 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.695965 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.696183 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.696272 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.696485 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.696582 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.696786 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.696874 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.697097 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.697182 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.697420 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.697551 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.697768 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.697854 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.698081 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.698204 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.698392 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.698486 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.698707 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.698793 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699012 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699105 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699314 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699400 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699617 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699709 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.699921 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700015 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700222 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700307 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700533 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700620 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700843 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.700940 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.701156 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.701249 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.704401 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.704558 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.704687 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.704813 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.704921 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705027 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705146 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705252 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705252 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705473 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705588 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705692 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705796 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705899 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.705899 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706105 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706219 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706324 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706427 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706531 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706643 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.706760 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707438 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707579 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707663 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707741 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707817 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707895 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.707972 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708049 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708126 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708209 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708344 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708435 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708514 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708592 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708668 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708745 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708831 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708909 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.708994 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709074 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709158 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709245 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709325 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709402 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709540 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709622 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709699 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709788 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709876 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.709966 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710045 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710191 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710279 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710499 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710585 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710827 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.710912 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.711142 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.711227 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.711452 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.711541 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.711758 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.711842 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712065 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712167 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712376 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712467 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712680 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712765 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.712987 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.713081 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.713297 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.713380 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.713636 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.713724 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.713944 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714044 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714264 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714357 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714573 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714658 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714880 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.714976 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.715180 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.715265 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.715484 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.715577 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.715788 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.715903 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716096 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716190 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716396 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716488 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716699 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716801 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.716996 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.717083 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.717298 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.717407 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.717619 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.717708 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.717921 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718009 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718221 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718312 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718530 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718626 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718833 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.718918 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.719131 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.719226 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.719434 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.719519 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.719729 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.719820 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.720029 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.720143 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.720988 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721064 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721064 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721184 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721333 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721405 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721509 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721582 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721660 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721759 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721871 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.721955 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.722170 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.722262 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.723044 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.723168 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.723416 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.723496 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.723740 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.723901 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.724064 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.724164 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.724379 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.724467 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.724691 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.724777 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725000 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725095 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725302 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725389 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725645 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725734 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.725953 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726054 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726269 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726357 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726569 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726655 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726878 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.726974 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.727186 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.727273 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.727514 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.727601 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.727821 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.727907 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.728139 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.728225 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.728442 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.728529 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.728748 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.728844 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729053 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729140 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729357 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729444 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729688 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729777 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.729992 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.730078 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.730306 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.730393 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.730610 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.730705 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.730922 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731009 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731224 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731324 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731531 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731617 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731829 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.731924 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.732139 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.732289 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.732437 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.732525 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.732745 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.732831 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.733051 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.733149 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.733375 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.733482 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.733712 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.733797 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734015 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734114 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734323 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734415 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734623 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734718 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.734926 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735022 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735229 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735317 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735528 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735616 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735829 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.735916 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.736129 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.736216 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.736434 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.736520 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.736735 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.736830 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737038 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737124 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737336 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737422 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737666 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737754 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.737965 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.738079 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.738857 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.738945 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.739205 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.739305 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.739486 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.739573 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.739794 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.739895 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.740110 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.740196 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.740419 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.740513 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.740728 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.740832 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.741034 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.741137 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.741344 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.741431 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.741696 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.741800 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742001 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742089 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742301 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742388 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742604 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742765 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742901 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.742989 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.743213 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.743308 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.743528 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.743614 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.743828 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.743915 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.744131 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.744217 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.744438 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.744525 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.744740 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.744824 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745048 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745134 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745351 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745438 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745679 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745766 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.745996 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.746095 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.746304 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.746391 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.746607 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.746796 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.746913 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747013 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747218 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747305 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747522 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747609 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747827 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.747923 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.748144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.748237 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.748447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.748532 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.748757 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.748889 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749146 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749360 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749446 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749690 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749794 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.749999 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.750093 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.750315 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.750566 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.750731 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.750893 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.750980 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.751204 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.751291 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.751512 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.751610 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.751822 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.751915 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.752166 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.752393 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.752489 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.752727 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.752823 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.753045 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.753133 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.753366 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.753496 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.753719 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.753869 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.754052 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.754164 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.754460 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.754567 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.754770 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.754859 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755073 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755162 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755375 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755470 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755675 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755762 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.755977 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756071 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756274 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756361 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756570 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756657 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756868 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.756955 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.757165 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.757259 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.757476 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.757580 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.757781 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.757868 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.758084 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.758226 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.758382 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.758482 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.758702 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.758789 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759005 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759092 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759303 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759403 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759603 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759698 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759899 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.759985 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.760205 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.760299 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.760517 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.760610 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.760827 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.760921 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.761135 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.761223 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.761441 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.761582 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.761841 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.761937 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.762138 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.762224 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.762456 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.762589 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.762756 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.762843 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763052 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763140 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763350 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763446 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763653 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763739 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.763953 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764048 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764292 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764426 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764551 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764647 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764852 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.764940 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.765152 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.765247 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.765539 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.765642 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.765784 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.765871 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766086 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766173 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766382 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766477 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766686 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766773 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.766986 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767074 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767282 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767385 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767578 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767665 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767880 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.767967 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.768181 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.768274 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.768473 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.768561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.768779 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.768866 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.769074 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.769162 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.769412 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.769567 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.769747 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.769913 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770060 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770224 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770365 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770525 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770680 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770836 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.770982 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.771141 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.771301 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.771439 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.771607 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.771757 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.771916 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772064 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772220 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772364 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772530 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772665 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772839 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.772952 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.773141 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.773250 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.773480 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.773586 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.773803 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.773890 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.774112 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.774211 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.774420 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.774585 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.774732 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.774819 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775033 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775118 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775332 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775429 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775631 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775718 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.775929 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776016 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776231 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776528 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776622 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776825 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.776919 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.777122 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.777209 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.777420 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.777528 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.777739 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.777826 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778047 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778141 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778348 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778434 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778673 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.778942 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779028 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779237 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779330 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779538 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779633 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779857 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.779943 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.780164 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.780250 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.780471 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.780567 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.780778 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.780864 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.781082 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.781169 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.781385 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.781509 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.781719 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.781806 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782026 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782113 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782324 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782412 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782631 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782758 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.782935 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783022 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783239 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783334 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783536 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783625 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783833 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.783920 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.784145 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.784233 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.784449 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.784580 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.784753 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.784840 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.785659 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.785752 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.786128 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.786226 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.786409 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.786503 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.786707 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.786793 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787009 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787103 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787314 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787409 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787618 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787715 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.787922 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788017 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788224 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788319 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788621 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788841 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.788927 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.789143 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.789242 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.789445 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.789566 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.789768 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.789855 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790067 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790167 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790370 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790457 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790673 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790759 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.790971 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791058 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791279 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791365 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791578 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791664 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791878 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.791966 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.792181 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.792276 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.792479 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.792566 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.792782 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.792874 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.793078 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.793163 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.793402 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.793558 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.793736 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.793825 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794047 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794134 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794354 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794450 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794664 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794751 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.794966 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795051 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795276 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795372 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795585 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795672 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795885 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.795972 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.796274 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.796369 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.796585 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.796671 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.796887 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.796973 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.797194 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.797290 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.797510 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.797613 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.797811 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.797898 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.798114 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.798227 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.798433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.798542 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.798734 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.798854 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799032 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799165 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799330 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799468 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799644 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799765 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.799941 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.800078 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.800253 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.800404 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.801317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.801499 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.801665 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.801790 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.801968 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.802098 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.802376 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.802472 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.802681 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.802771 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.802987 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.803073 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.803303 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.803431 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.803618 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.803746 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.803935 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.804052 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.804235 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.804467 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.804565 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.804781 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.804869 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.805092 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.805182 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.805416 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.805523 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.805747 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.805842 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806057 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806145 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806355 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806443 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806671 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806758 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.806983 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.807069 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.807290 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.807386 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.807605 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.807693 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.807918 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808011 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808235 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808331 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808543 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808638 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808867 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.808955 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.809193 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.809289 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.809510 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.809601 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.809811 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.809911 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.810113 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.810250 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.810412 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.810576 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.810709 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.810889 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811022 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811212 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811306 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811539 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811626 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811847 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.811943 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.812159 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.812248 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.812473 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.812563 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.812782 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.812880 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.813090 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.813178 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.813384 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.813496 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.813734 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.813831 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814041 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814128 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814352 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814438 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814663 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814752 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.814964 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815052 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815267 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815353 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815570 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815656 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815868 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.815956 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.816198 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.816332 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.816496 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.816585 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.816905 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.816992 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.817210 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.817304 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.817551 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.817644 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.817876 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.817974 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.818190 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.818290 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.818494 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.818587 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.818800 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.818886 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.819111 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.819206 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.819432 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.819526 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.819743 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.819830 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820059 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820158 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820358 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820444 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820654 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820741 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.820959 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821046 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821257 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821344 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821584 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821675 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821883 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.821985 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.822186 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.822274 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.822482 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.822570 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.822779 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.822874 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.823075 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.823162 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.823390 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.823477 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.823686 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.823775 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824000 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824086 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824300 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824400 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824598 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824692 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824897 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.824984 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.825192 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.825288 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.825514 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.825604 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.825840 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.825928 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.826144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.826243 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.826444 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.826531 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.826763 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.826848 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827069 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827169 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827375 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827467 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827676 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827761 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.827981 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828067 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828288 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828382 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828596 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828684 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.828999 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.829214 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.829300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.829548 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.829640 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.829862 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.829950 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.830172 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.830258 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.830485 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.830681 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.830802 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831003 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831118 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831310 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831434 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831615 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831781 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.831947 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.832255 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.832342 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.832626 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.832721 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.832942 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.833029 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.833248 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.833495 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.833587 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.833835 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.833924 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.834154 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.834242 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.834470 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.834566 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.834785 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.834872 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.835098 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.835185 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.835412 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.835507 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.835721 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.835809 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836030 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836115 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836335 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836433 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836643 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836736 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.836969 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.837063 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.837266 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.837355 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.837600 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.837692 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.837911 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838009 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838217 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838306 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838522 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838609 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838832 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.838919 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.839139 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.839228 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.839446 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.839533 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.839751 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.839847 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840054 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840141 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840361 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840449 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840668 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840763 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.840985 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.841073 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.841293 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.841379 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.841632 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.841721 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.841940 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.842026 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.842248 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.842335 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.842556 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.842645 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.842863 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.843061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.843179 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.843368 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.843531 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.843691 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.843804 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844009 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844141 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844325 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844466 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844635 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844785 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.844944 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.845104 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.845262 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.845421 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.845587 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.845885 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.845971 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.846192 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.846289 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.846497 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.846584 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.846796 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.846891 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.847110 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.847209 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.847997 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.848099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.848349 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.848449 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.848667 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.848767 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.848966 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.849055 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.849295 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.849514 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.849627 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.849861 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.849949 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.850173 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.850260 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.850491 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.850588 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.850810 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.850899 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.851121 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.851207 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.851419 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.851523 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.851735 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.851823 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.852035 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.852263 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.852358 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.852616 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.852712 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.852922 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853009 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853221 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853541 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853632 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853848 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.853937 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.854151 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.854247 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.854449 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.854544 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.854750 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.854838 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855048 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855367 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855457 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855667 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855763 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.855965 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856053 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856261 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856348 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856563 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856652 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856859 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.856947 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.857155 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.857249 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.857472 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.857563 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.857769 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.857859 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858075 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858176 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858371 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858458 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858672 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858760 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.858969 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859062 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859279 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859373 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859573 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859658 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859873 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.859960 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.860180 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.860273 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.860486 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.860574 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.860800 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.860885 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.861098 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.861193 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.861408 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.861527 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.861736 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.861822 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.862048 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.862146 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.862351 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.862445 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.862654 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.862741 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.863011 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.863639 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.863854 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.863953 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.864264 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.864376 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.864573 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.864704 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.864892 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.865021 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.865208 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.865350 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.865557 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.865700 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.865879 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866004 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866191 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866307 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866540 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866629 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866861 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.866956 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.867203 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.867397 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.867512 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.867734 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.867821 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868056 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868157 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868407 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868497 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868693 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868779 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.868999 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.869085 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.869308 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.869399 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.869637 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.869726 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.869941 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870028 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870243 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870332 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870547 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870633 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870848 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.870946 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.871150 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.871236 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.871456 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.871543 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.871764 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.871863 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.872077 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.872165 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.872382 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.872468 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.872692 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.872789 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873000 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873086 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873302 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873387 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873632 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873724 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.873939 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874027 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874245 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874332 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874554 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874643 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874878 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.874966 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.875189 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.875288 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.875490 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.875578 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.875806 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.875892 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.876126 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.876226 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.876440 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.876528 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.876754 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.876848 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.877065 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.877166 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.877378 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.877498 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.877720 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.877802 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.878012 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.878114 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.878329 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.878417 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.878661 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.879354 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.879508 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.879607 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.879794 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.879882 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.880117 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.880245 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.880438 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.880527 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.880741 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.880828 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881041 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881136 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881341 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881429 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881671 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881762 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.881984 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.882085 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.882289 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.882379 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.882587 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.882675 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.882884 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883006 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883187 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883336 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883485 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883663 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883786 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.883972 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884089 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884278 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884390 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884587 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884695 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884898 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.884986 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.885217 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.885312 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.885552 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.885658 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.885862 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.885949 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.886156 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.886243 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.886454 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.886554 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.886755 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.886881 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887053 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887151 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887353 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887450 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887650 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887737 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.887945 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888032 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888242 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888338 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888549 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888663 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888862 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.888958 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.889169 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.889258 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.889496 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.889585 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.889806 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.889900 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.890115 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.890208 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.890417 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.890513 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.890721 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.890807 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.891027 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.891115 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.891331 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.891417 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.891632 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.891717 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892001 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892106 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892259 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892347 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892565 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892660 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892872 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.892967 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.893177 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.893264 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.893504 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.893609 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.893813 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.893901 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.894132 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.894251 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895008 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895132 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895312 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895421 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895648 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895734 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.895981 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.896069 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.896290 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.896377 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.896597 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.896691 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.896902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897040 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897210 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897297 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897546 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897648 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897855 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.897943 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.898160 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.898247 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.898464 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.898561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.898768 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.898862 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.899077 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.899164 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.899387 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.899487 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.899693 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.899780 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900001 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900088 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900309 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900446 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900625 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900711 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.900937 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901024 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901239 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901326 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901576 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901666 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901892 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.901979 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.902206 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.902296 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.902522 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.902614 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.902831 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.902917 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.903145 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.903234 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.903457 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.903543 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.903764 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.903850 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.904062 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.904149 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.904298 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:53:08.904386 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.904699 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.905027 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.905355 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.905728 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.906045 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.906390 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.906722 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.907035 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.907348 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.907653 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 01:53:08.907897 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 01:53:09.059740 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO dbcounter [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Registered counter for database nova_api Aug 30 01:53:09.062410 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO dbcounter [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Registered counter for database nova_api Aug 30 01:53:09.081369 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_db.sqlalchemy.engines [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.083106 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_db.sqlalchemy.engines [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.088168 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writer thread running {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.089714 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writer thread running {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.147119 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.context [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f5299b58-fdcd-461c-bb89-e110eb2a6931(cell1) {{(pid=105873) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:53:09.147562 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.context [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f5299b58-fdcd-461c-bb89-e110eb2a6931(cell1) {{(pid=105872) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 01:53:09.150908 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:09.151368 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_concurrency.lockutils [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:09.151465 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:09.151834 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_concurrency.lockutils [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:09.152914 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:09.153375 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_concurrency.lockutils [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:09.153682 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:09.154127 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_concurrency.lockutils [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:53:09.154217 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:09.154568 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_concurrency.lockutils [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:53:09.156132 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:09.156548 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_concurrency.lockutils [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:53:09.158120 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO dbcounter [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Registered counter for database nova_cell0 Aug 30 01:53:09.158541 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO dbcounter [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Registered counter for database nova_cell0 Aug 30 01:53:09.162751 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO dbcounter [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Registered counter for database nova_cell1 Aug 30 01:53:09.163403 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO dbcounter [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Registered counter for database nova_cell1 Aug 30 01:53:09.169963 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_db.sqlalchemy.engines [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.171673 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_db.sqlalchemy.engines [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.173388 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_db.sqlalchemy.engines [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.176273 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_db.sqlalchemy.engines [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.179356 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writer thread running {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.179704 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writer thread running {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.181393 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writer thread running {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.184239 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writer thread running {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.323365 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO dbcounter [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Registered counter for database nova_cell0 Aug 30 01:53:09.328450 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO dbcounter [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Registered counter for database nova_cell0 Aug 30 01:53:09.332201 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_db.sqlalchemy.engines [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.335668 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG oslo_db.sqlalchemy.engines [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 01:53:09.337000 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writer thread running {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.340150 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writer thread running {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 01:53:09.755465 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: WARNING keystonemiddleware.auth_token [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:53:09.764796 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: WARNING keystonemiddleware.auth_token [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:53:09.772753 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: WARNING keystonemiddleware.auth_token [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:53:09.780069 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: WARNING keystonemiddleware.auth_token [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:53:10.114497 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: WARNING keystonemiddleware.auth_token [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:53:10.120453 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: WARNING keystonemiddleware.auth_token [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:53:10.125697 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56063d8479c0 pid: 105873 (default app) Aug 30 01:53:10.127744 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:53:10.128978 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Aug 30 01:53:10.129391 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Aug 30 01:53:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:53:10.131525 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: WARNING keystonemiddleware.auth_token [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 01:53:10.137474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: WARNING keystonemiddleware.auth_token [None req-852a33ca-93c1-4538-9931-904be183f8bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 01:53:10.142711 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56063d8479c0 pid: 105872 (default app) Aug 30 01:54:31.424416 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:31.425417 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Aug 30 01:54:31.425824 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:31.439112 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writing DB stats nova_api:SELECT=3 {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:31.440706 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writing DB stats nova_cell1:SELECT=3 {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:31.441906 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writing DB stats nova_cell0:SELECT=3 {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:31.443114 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:32.335906 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-3885721d-032c-416e-884b-d9cf745645ce admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:32.368463 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-3885721d-032c-416e-884b-d9cf745645ce admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935647 Aug 30 01:54:32.369593 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 01:54:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:54:34.739274 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:34.740809 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-5db325c5-603f-40a2-838e-899983f76e06 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001379 Aug 30 01:54:34.740809 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:35.180241 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-7e9f23e7-2bfb-4099-af8c-a464356566e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "id": "c1", "vcpus": 1, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:35.290197 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-7e9f23e7-2bfb-4099-af8c-a464356566e8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.533858 Aug 30 01:54:35.290748 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:54:35.304634 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_api:SELECT=3 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:35.305427 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_cell0:SELECT=3 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:35.306406 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_cell1:SELECT=3 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:35.307419 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:54:35.517226 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-7d9bc409-1f10-4b4c-90b4-b6e4eb218c1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:35.626757 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-7d9bc409-1f10-4b4c-90b4-b6e4eb218c1a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.327152 Aug 30 01:54:35.627341 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 01:54:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:54:37.978172 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-7e9f23e7-2bfb-4099-af8c-a464356566e8 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:37.979196 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-7e9f23e7-2bfb-4099-af8c-a464356566e8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 30 01:54:37.979607 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:38.692092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-834b3b41-1865-47f7-acce-4a93531530fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:38.826398 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-834b3b41-1865-47f7-acce-4a93531530fe admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.839527 Aug 30 01:54:38.828093 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:54:38.839890 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-91f7fe8a-d875-4ec5-a7c1-c212757260f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:38.933118 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-91f7fe8a-d875-4ec5-a7c1-c212757260f2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096873 Aug 30 01:54:38.933891 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 01:54:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:54:41.280355 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-834b3b41-1865-47f7-acce-4a93531530fe admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:41.281343 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-834b3b41-1865-47f7-acce-4a93531530fe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 30 01:54:41.281769 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:41.680068 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-6349454b-35d9-4ba8-acfc-72467159d786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "swap": 0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:41.768602 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-6349454b-35d9-4ba8-acfc-72467159d786 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480751 Aug 30 01:54:41.769082 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:54:41.781648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-7c8005e5-f9e8-4648-bf2d-505ec90a983f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:41.846248 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-7c8005e5-f9e8-4648-bf2d-505ec90a983f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068873 Aug 30 01:54:41.847068 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 01:54:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:54:44.214154 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-6349454b-35d9-4ba8-acfc-72467159d786 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:44.215736 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-6349454b-35d9-4ba8-acfc-72467159d786 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002990 Aug 30 01:54:44.216131 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:44.672036 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-dadeed23-b5f0-442c-b528-826932fab46c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "id": "d3", "swap": 0, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:44.735125 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-dadeed23-b5f0-442c-b528-826932fab46c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.511506 Aug 30 01:54:44.735815 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:54:44.747873 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-94c20b2e-6209-43ef-8f16-90cdddd6b782 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:44.847662 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-94c20b2e-6209-43ef-8f16-90cdddd6b782 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103568 Aug 30 01:54:44.848261 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 01:54:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:54:47.359440 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-dadeed23-b5f0-442c-b528-826932fab46c admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:47.361178 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-dadeed23-b5f0-442c-b528-826932fab46c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Aug 30 01:54:47.361993 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:47.828858 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-60ed25d3-45f5-47ef-8252-05978dad84cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "id": "d4"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:47.927179 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-60ed25d3-45f5-47ef-8252-05978dad84cb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557267 Aug 30 01:54:47.928028 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:54:47.940783 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-a872796b-f3ed-4c43-9936-8f13fab52ea9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:48.028938 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-a872796b-f3ed-4c43-9936-8f13fab52ea9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091950 Aug 30 01:54:48.041478 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 01:54:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:54:50.544533 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-60ed25d3-45f5-47ef-8252-05978dad84cb admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:50.546461 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-60ed25d3-45f5-47ef-8252-05978dad84cb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002363 Aug 30 01:54:50.546995 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:51.019481 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-1f5719d4-4baa-47f2-9985-65fee9e2dc5d admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:51.051422 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-1f5719d4-4baa-47f2-9985-65fee9e2dc5d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497794 Aug 30 01:54:51.052415 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 01:54:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:54:53.554863 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-60ed25d3-45f5-47ef-8252-05978dad84cb admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:53.555883 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-60ed25d3-45f5-47ef-8252-05978dad84cb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 01:54:53.556293 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:53.979148 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-e7b1cf65-8cea-4189-8192-81347c4142a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:54.047219 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-e7b1cf65-8cea-4189-8192-81347c4142a8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.483011 Aug 30 01:54:54.047775 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:54:54.059914 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-1863c8ce-e81c-4a70-af26-69a92e219df3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:54.161793 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-1863c8ce-e81c-4a70-af26-69a92e219df3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105192 Aug 30 01:54:54.162498 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 01:54:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:54:56.524072 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-e7b1cf65-8cea-4189-8192-81347c4142a8 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:56.524970 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-e7b1cf65-8cea-4189-8192-81347c4142a8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 30 01:54:56.525364 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:56.905400 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-cf820620-47c7-4a0b-97e1-d2c41b10328e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "2", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:56.980497 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-cf820620-47c7-4a0b-97e1-d2c41b10328e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448837 Aug 30 01:54:56.982834 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:54:56.993234 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-9ecf667f-af73-44c9-bcba-c829b3f889ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:54:57.094993 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-9ecf667f-af73-44c9-bcba-c829b3f889ca admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105528 Aug 30 01:54:57.095589 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 01:54:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:54:59.507585 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-cf820620-47c7-4a0b-97e1-d2c41b10328e admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:54:59.508726 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-cf820620-47c7-4a0b-97e1-d2c41b10328e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 30 01:54:59.509156 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:54:59.974162 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-4a4ef6e8-be99-4b91-9dc7-0f0ef8e28c40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:00.695910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-4a4ef6e8-be99-4b91-9dc7-0f0ef8e28c40 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.180095 Aug 30 01:55:00.724491 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:54:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:55:00.724643 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-dc9e0ead-db20-4b4a-b970-23f1606a3263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:00.806285 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-dc9e0ead-db20-4b4a-b970-23f1606a3263 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099925 Aug 30 01:55:00.807121 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 01:55:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:03.214504 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-4a4ef6e8-be99-4b91-9dc7-0f0ef8e28c40 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:03.215417 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-4a4ef6e8-be99-4b91-9dc7-0f0ef8e28c40 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 30 01:55:03.216663 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:55:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:03.672649 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-ddfc3c9a-310f-42a9-a36b-fa542fef5070 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "id": "4"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:03.678188 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:03.744529 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-ddfc3c9a-310f-42a9-a36b-fa542fef5070 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521616 Aug 30 01:55:03.745301 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:55:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 01:55:03.758886 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-ce49ef57-072d-4bf7-835e-8b15633119ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:03.834918 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-ce49ef57-072d-4bf7-835e-8b15633119ed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080378 Aug 30 01:55:03.835662 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 01:55:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:55:06.291482 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-ddfc3c9a-310f-42a9-a36b-fa542fef5070 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:06.293090 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-ddfc3c9a-310f-42a9-a36b-fa542fef5070 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 30 01:55:06.293515 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:06.753841 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-fc0852aa-16b3-4953-8830-7f30c3241520 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "disk": 160, "id": "5", "swap": 0}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:06.876876 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-fc0852aa-16b3-4953-8830-7f30c3241520 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.576346 Aug 30 01:55:06.877766 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 01:55:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:55:06.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-d6491d76-eb60-4c4e-966b-895557141304 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:06.960120 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-d6491d76-eb60-4c4e-966b-895557141304 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073924 Aug 30 01:55:06.960867 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 01:55:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:55:25.696899 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-fc0852aa-16b3-4953-8830-7f30c3241520 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:25.697936 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-fc0852aa-16b3-4953-8830-7f30c3241520 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 30 01:55:25.698334 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:26.088224 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-5f167e18-f003-4fcc-a645-e6e7518bd5dc admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:26.108663 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-5f167e18-f003-4fcc-a645-e6e7518bd5dc admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403547 Aug 30 01:55:26.109194 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 01:55:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:27.169439 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-fc0852aa-16b3-4953-8830-7f30c3241520 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:27.170464 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-fc0852aa-16b3-4953-8830-7f30c3241520 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 01:55:27.170872 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:27.686629 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-b856f004-f2e0-47fb-8110-d1aab8dd1112 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:27.692232 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.wsgi [None req-b856f004-f2e0-47fb-8110-d1aab8dd1112 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-b856f004-f2e0-47fb-8110-d1aab8dd1112 admin admin] Request method failure captured: Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Accept: application/json Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Accept-Encoding: gzip, deflate Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Connection: keep-alive Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Content-Length: 0 Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Host: 10.222.0.27 Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Openstack-Api-Version: compute 2.90 Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Openstack-System-Scope: None Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: User-Agent: python-novaclient Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Auth-Token: gAAAAABjDW4Pq7HqRsvmGlq4bOnUOurLlNOu2_YfHD3-KJ-jt7lE3g7EFFxILjdmdD8jn5vQa5E3j1OG8jCwxj6IJqXhPgr_Hq0ZeenjYqVXJ1hSMSM5ChkSnJTiuTBJtrL37qJM9MddnVGDmHaWY4IpKu9BEG2CuhYcWq3JyFJSC9VPyXRxng0 Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Domain-Id: None Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Domain-Name: None Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Identity-Status: Confirmed Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Is-Admin-Project: True Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Domain-Id: default Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Domain-Name: Default Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Name: admin Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Role: reader,admin,member Aug 30 01:55:27.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Roles: reader,admin,member Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70bc9f42895844308fb4b9192314f80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant: admin Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant-Name: admin Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User: admin Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Domain-Id: default Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Domain-Name: Default Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Id: ac83d5ed111c4f4e8b3c3226bd3bbaba Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Name: admin Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: method: > Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: exception: Flavor 42 could not be found. Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: action_args: {'id': '42'} Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:27.697099 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:27.698320 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.699798 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-b856f004-f2e0-47fb-8110-d1aab8dd1112 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:27.701093 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-b856f004-f2e0-47fb-8110-d1aab8dd1112 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389746 Aug 30 01:55:27.701093 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 01:55:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:55:27.706454 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-1204c542-bdbc-413c-8fba-e7ec032a2ce9 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:27.710628 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:55:27.731257 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-1204c542-bdbc-413c-8fba-e7ec032a2ce9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028272 Aug 30 01:55:27.738922 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 01:55:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:27.742007 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-aa6c9f08-9454-45f3-854c-e4a00d946634 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:27.764568 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-aa6c9f08-9454-45f3-854c-e4a00d946634 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026561 Aug 30 01:55:27.765100 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 01:55:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:55:27.774502 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-bf42679b-17e8-4fa7-b394-719c650ba5d7 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:27.781153 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.wsgi [None req-bf42679b-17e8-4fa7-b394-719c650ba5d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-bf42679b-17e8-4fa7-b394-719c650ba5d7 admin admin] Request method failure captured: Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Accept: application/json Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Accept-Encoding: gzip, deflate Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Connection: keep-alive Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Content-Length: 0 Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Host: 10.222.0.27 Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Openstack-Api-Version: compute 2.90 Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Openstack-System-Scope: None Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: User-Agent: python-novaclient Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Auth-Token: gAAAAABjDW4Pq7HqRsvmGlq4bOnUOurLlNOu2_YfHD3-KJ-jt7lE3g7EFFxILjdmdD8jn5vQa5E3j1OG8jCwxj6IJqXhPgr_Hq0ZeenjYqVXJ1hSMSM5ChkSnJTiuTBJtrL37qJM9MddnVGDmHaWY4IpKu9BEG2CuhYcWq3JyFJSC9VPyXRxng0 Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Domain-Id: None Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Domain-Name: None Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Identity-Status: Confirmed Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Is-Admin-Project: True Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Domain-Id: default Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Domain-Name: Default Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Name: admin Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Role: reader,admin,member Aug 30 01:55:27.784413 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Roles: reader,admin,member Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70bc9f42895844308fb4b9192314f80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant: admin Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant-Name: admin Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User: admin Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Domain-Id: default Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Domain-Name: Default Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Id: ac83d5ed111c4f4e8b3c3226bd3bbaba Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Name: admin Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: method: > Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: exception: Flavor 42 could not be found. Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: action_args: {'id': '42'} Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:27.786092 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:27.787061 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:27.788393 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-bf42679b-17e8-4fa7-b394-719c650ba5d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:27.790519 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-bf42679b-17e8-4fa7-b394-719c650ba5d7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014850 Aug 30 01:55:27.790519 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 01:55:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:55:28.753876 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-aa6c9f08-9454-45f3-854c-e4a00d946634 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:28.754873 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-aa6c9f08-9454-45f3-854c-e4a00d946634 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 30 01:55:28.755291 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:29.284530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-91809be8-ecb0-4bb6-ba95-cc60f8a8fac9 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:29.289847 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.wsgi [None req-91809be8-ecb0-4bb6-ba95-cc60f8a8fac9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-91809be8-ecb0-4bb6-ba95-cc60f8a8fac9 admin admin] Request method failure captured: Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Accept: application/json Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Accept-Encoding: gzip, deflate Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Connection: keep-alive Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Content-Length: 0 Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Host: 10.222.0.27 Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Openstack-Api-Version: compute 2.90 Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Openstack-System-Scope: None Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: User-Agent: python-novaclient Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Auth-Token: gAAAAABjDW4QgnPy6eGANXUIbcHgVE7dYgjpZT4jf4RTjxEgk-g---EQYk2Mgk0VzA4t5NYr-bZkNVIOI0q-1H8XCWE6CmOd_do8pLVIQ7Em_tzwbJOOJQm6qC7-tg0A_7V2CiBoFaDigUggjmWX05QfU6PFHd5PM2XO-sk0xVOicYazcpmHar4 Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Domain-Id: None Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Domain-Name: None Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Identity-Status: Confirmed Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Is-Admin-Project: True Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Domain-Id: default Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Domain-Name: Default Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Name: admin Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Role: reader,admin,member Aug 30 01:55:29.291317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Roles: reader,admin,member Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70bc9f42895844308fb4b9192314f80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant: admin Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant-Name: admin Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User: admin Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Domain-Id: default Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Domain-Name: Default Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Id: ac83d5ed111c4f4e8b3c3226bd3bbaba Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Name: admin Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: method: > Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: exception: Flavor 84 could not be found. Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: action_args: {'id': '84'} Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:29.293447 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:29.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.295572 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-91809be8-ecb0-4bb6-ba95-cc60f8a8fac9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:29.296616 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-91809be8-ecb0-4bb6-ba95-cc60f8a8fac9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392570 Aug 30 01:55:29.296616 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 01:55:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:55:29.303054 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-01c19247-b502-44be-b506-abc31391fa36 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:29.318056 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-01c19247-b502-44be-b506-abc31391fa36 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018523 Aug 30 01:55:29.318577 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 01:55:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:55:29.327896 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-ac38bbc4-0341-44bd-91ca-49b488554b80 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:29.343034 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-ac38bbc4-0341-44bd-91ca-49b488554b80 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018641 Aug 30 01:55:29.343558 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 01:55:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:29.352892 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-8108176e-b12a-4745-a4b3-0af722d26a5d admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:29.359083 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.wsgi [None req-8108176e-b12a-4745-a4b3-0af722d26a5d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-8108176e-b12a-4745-a4b3-0af722d26a5d admin admin] Request method failure captured: Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Accept: application/json Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Accept-Encoding: gzip, deflate Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Connection: keep-alive Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Content-Length: 0 Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Host: 10.222.0.27 Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Openstack-Api-Version: compute 2.90 Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Openstack-System-Scope: None Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: User-Agent: python-novaclient Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Auth-Token: gAAAAABjDW4QgnPy6eGANXUIbcHgVE7dYgjpZT4jf4RTjxEgk-g---EQYk2Mgk0VzA4t5NYr-bZkNVIOI0q-1H8XCWE6CmOd_do8pLVIQ7Em_tzwbJOOJQm6qC7-tg0A_7V2CiBoFaDigUggjmWX05QfU6PFHd5PM2XO-sk0xVOicYazcpmHar4 Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Domain-Id: None Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Domain-Name: None Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Identity-Status: Confirmed Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Is-Admin-Project: True Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Domain-Id: default Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Domain-Name: Default Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Name: admin Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Role: reader,admin,member Aug 30 01:55:29.360561 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Roles: reader,admin,member Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70bc9f42895844308fb4b9192314f80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant: admin Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant-Name: admin Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User: admin Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Domain-Id: default Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Domain-Name: Default Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Id: ac83d5ed111c4f4e8b3c3226bd3bbaba Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Name: admin Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: method: > Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: exception: Flavor 84 could not be found. Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: action_args: {'id': '84'} Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:29.362144 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:29.363988 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:29.365318 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-8108176e-b12a-4745-a4b3-0af722d26a5d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:29.372315 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-8108176e-b12a-4745-a4b3-0af722d26a5d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012512 Aug 30 01:55:29.372315 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 01:55:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 01:55:30.342042 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-ac38bbc4-0341-44bd-91ca-49b488554b80 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:30.343069 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-ac38bbc4-0341-44bd-91ca-49b488554b80 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 30 01:55:30.343463 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:30.879770 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-273cc7e0-7ae7-4281-aa1d-7a3e19dd11ea admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:30.885750 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.wsgi [None req-273cc7e0-7ae7-4281-aa1d-7a3e19dd11ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-273cc7e0-7ae7-4281-aa1d-7a3e19dd11ea admin admin] Request method failure captured: Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Accept: application/json Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Accept-Encoding: gzip, deflate Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Connection: keep-alive Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Content-Length: 0 Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Host: 10.222.0.27 Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Openstack-Api-Version: compute 2.90 Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Openstack-System-Scope: None Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: User-Agent: python-novaclient Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Auth-Token: gAAAAABjDW4SL1gaGjLvA0mrmW0jq8mRCgBHkGWUaS8uaKqp1-pDvX6vtsrlMzNVAO68nblcKsaxZphxYJqL0SLpIDRNqZupwkO4MQQVdeWMGRayXC1UP1-QqodqBIUEXQjsokPu1wRgkBcemZ2vYEDvROLP8R6LSrsETV-UEYbcuBgFxxg5Itw Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Domain-Id: None Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Domain-Name: None Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Identity-Status: Confirmed Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Is-Admin-Project: True Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Domain-Id: default Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Domain-Name: Default Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Project-Name: admin Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Role: reader,admin,member Aug 30 01:55:30.887300 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Roles: reader,admin,member Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70bc9f42895844308fb4b9192314f80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant: admin Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-Tenant-Name: admin Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User: admin Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Domain-Id: default Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Domain-Name: Default Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Id: ac83d5ed111c4f4e8b3c3226bd3bbaba Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: X-User-Name: admin Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: method: > Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: exception: Flavor 451 could not be found. Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: action_args: {'id': '451'} Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:30.888887 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:30.889818 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.890954 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-273cc7e0-7ae7-4281-aa1d-7a3e19dd11ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:30.892190 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-273cc7e0-7ae7-4281-aa1d-7a3e19dd11ea admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.404301 Aug 30 01:55:30.892190 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 01:55:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:55:30.898391 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-c2223aa8-d7c8-4739-94b6-7f6e84e436e1 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:30.913613 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-c2223aa8-d7c8-4739-94b6-7f6e84e436e1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018688 Aug 30 01:55:30.914137 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 01:55:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:30.924151 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:30.938981 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018341 Aug 30 01:55:30.939507 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 01:55:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:55:30.948733 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-c7fd1a5f-ae85-4c6c-9770-39957cec470d admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:30.954368 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.wsgi [None req-c7fd1a5f-ae85-4c6c-9770-39957cec470d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-c7fd1a5f-ae85-4c6c-9770-39957cec470d admin admin] Request method failure captured: Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Accept: application/json Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Accept-Encoding: gzip, deflate Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Connection: keep-alive Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Content-Length: 0 Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Host: 10.222.0.27 Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Openstack-Api-Version: compute 2.90 Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Openstack-System-Scope: None Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: User-Agent: python-novaclient Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Auth-Token: gAAAAABjDW4SL1gaGjLvA0mrmW0jq8mRCgBHkGWUaS8uaKqp1-pDvX6vtsrlMzNVAO68nblcKsaxZphxYJqL0SLpIDRNqZupwkO4MQQVdeWMGRayXC1UP1-QqodqBIUEXQjsokPu1wRgkBcemZ2vYEDvROLP8R6LSrsETV-UEYbcuBgFxxg5Itw Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Domain-Id: None Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Domain-Name: None Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Identity-Status: Confirmed Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Is-Admin-Project: True Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Domain-Id: default Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Domain-Name: Default Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Project-Name: admin Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Role: reader,admin,member Aug 30 01:55:30.955902 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Roles: reader,admin,member Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_70bc9f42895844308fb4b9192314f80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/70bc9f42895844308fb4b9192314f80b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant: admin Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant-Id: 70bc9f42895844308fb4b9192314f80b Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-Tenant-Name: admin Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User: admin Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Domain-Id: default Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Domain-Name: Default Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Id: ac83d5ed111c4f4e8b3c3226bd3bbaba Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: X-User-Name: admin Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: method: > Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: exception: Flavor 451 could not be found. Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: action_args: {'id': '451'} Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:55:30.957530 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:30.958648 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: ERROR nova.api.openstack.wsgi Aug 30 01:55:30.959910 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-c7fd1a5f-ae85-4c6c-9770-39957cec470d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:55:30.961106 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-c7fd1a5f-ae85-4c6c-9770-39957cec470d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012192 Aug 30 01:55:30.961106 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 01:55:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 01:55:31.929188 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:31.930204 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 30 01:55:31.930591 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:55:32.464881 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-e3e82714-bde6-4d42-b214-de7e84d0fcde admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:32.549356 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-e3e82714-bde6-4d42-b214-de7e84d0fcde admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481825 Aug 30 01:55:32.549935 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 01:55:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:55:33.526953 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:33.528562 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Aug 30 01:55:33.528968 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:34.191136 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-165cccd9-5d26-4208-a152-19cda0d37c98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:34.309404 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-165cccd9-5d26-4208-a152-19cda0d37c98 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.640102 Aug 30 01:55:34.309985 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 01:55:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:55:35.276391 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:35.278160 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Aug 30 01:55:35.278557 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:35.804390 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-27db108f-2129-4416-8cf3-74f4d35caec1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:35.937242 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-27db108f-2129-4416-8cf3-74f4d35caec1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.521361 Aug 30 01:55:35.937740 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 01:55:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:55:36.915036 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:36.916038 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 30 01:55:36.916431 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:37.441844 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-e4fe9be9-1746-4ec8-a251-7597ccc4796c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:55:37.524225 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-e4fe9be9-1746-4ec8-a251-7597ccc4796c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470709 Aug 30 01:55:37.524686 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 01:55:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:55:38.488334 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:38.489330 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 30 01:55:38.489753 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 01:55:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:55:39.014692 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-e18401a3-efca-4bae-a469-48732cb8c351 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:55:39.035267 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-e18401a3-efca-4bae-a469-48732cb8c351 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408458 Aug 30 01:55:39.035807 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Aug 30 01:55:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:33.976258 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:33.977131 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-4ee9d766-4c74-4474-a36a-77d5776a0749 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Aug 30 01:56:33.977573 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 01:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:56:33.988261 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:34.367758 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-26a4b024-3395-47f4-8ba3-a43367150375 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.387978 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-26a4b024-3395-47f4-8ba3-a43367150375 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404246 Aug 30 01:56:34.388510 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 01:56:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:56:34.409503 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG dbcounter [-] [105872] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:56:34.413224 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-452a1e1c-344e-4760-a8e0-8a3afe6c37d1 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.421997 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-452a1e1c-344e-4760-a8e0-8a3afe6c37d1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013931 Aug 30 01:56:34.425192 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Aug 30 01:56:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:34.435097 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-c3371ec6-5ba6-457a-96aa-04f6e4d6b1fa admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.442634 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-c3371ec6-5ba6-457a-96aa-04f6e4d6b1fa admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011285 Aug 30 01:56:34.443138 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Aug 30 01:56:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:34.455132 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.462879 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011624 Aug 30 01:56:34.463393 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Aug 30 01:56:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:56:34.475051 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-786bca97-9cb1-414c-8469-1d8b12ddf112 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:56:34.483258 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-786bca97-9cb1-414c-8469-1d8b12ddf112 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011738 Aug 30 01:56:34.483776 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Aug 30 01:56:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:00:02.008166 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:02.009193 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 30 02:00:02.009622 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 02:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:02.151007 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_api:SELECT=6 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:02.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:02.296358 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:02.296830 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:02.297269 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:02.298028 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:02.298467 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:02.298885 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:02.334898 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-cf8a6d6e-6907-4f2f-8012-d9077bdaa4b6 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.185353 Aug 30 02:00:02.335469 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 02:00:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:00:03.181055 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:03.182072 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 30 02:00:03.182485 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 02:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:03.375317 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:03.378669 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:03.379119 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:03.379565 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:03.380271 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:03.380733 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:03.381137 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:03.400869 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-f9bc52b7-720b-42c3-886a-9d3f9b28496b admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077676 Aug 30 02:00:03.401405 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 02:00:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:00:14.617223 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:14.618246 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 30 02:00:14.618628 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 02:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:00:14.765634 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_cell0:SELECT=4 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:14.766802 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_cell1:SELECT=4 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:14.767414 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG dbcounter [-] [105873] Writing DB stats nova_api:SELECT=8 {{(pid=105873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:00:14.819215 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:14.819755 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:14.820342 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:14.820761 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:14.821485 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:14.821916 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:14.822320 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:14.848651 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-c8a10546-e61e-4d61-b033-778854741460 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087591 Aug 30 02:00:14.849201 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 02:00:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:00:15.673303 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: DEBUG nova.api.openstack.wsgi [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] Calling method '>' {{(pid=105872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:15.674343 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: INFO nova.api.openstack.requestlog [None req-2fd9d652-f6df-4bb5-8656-a50dd9e6b576 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 02:00:15.674758 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: [pid: 105872|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 02:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:00:15.865855 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG nova.api.openstack.wsgi [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Calling method '>' {{(pid=105873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:00:15.869263 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:15.869875 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:15.870295 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:15.871022 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:00:15.871456 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:00:15.871944 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: DEBUG oslo_concurrency.lockutils [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:00:15.895206 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: INFO nova.api.openstack.requestlog [None req-d264d888-5c21-4c24-bff5-520306f99b9f admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079930 Aug 30 02:00:15.895649 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: [pid: 105873|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 02:00:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:01:11.775494 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: Tue Aug 30 02:01:11 2022 - graceful shutdown triggered... Aug 30 02:01:11.776020 dv-cinder-819667-6-iscsi devstack@n-api.service[105872]: Gracefully killing worker 1 (pid: 105872)... Aug 30 02:01:11.775617 dv-cinder-819667-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 02:01:11.776830 dv-cinder-819667-6-iscsi devstack@n-api.service[105873]: Gracefully killing worker 2 (pid: 105873)... Aug 30 02:01:12.779974 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: worker 1 buried after 1 seconds Aug 30 02:01:12.780437 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: worker 2 buried after 1 seconds Aug 30 02:01:12.780437 dv-cinder-819667-6-iscsi devstack@n-api.service[105871]: goodbye to uWSGI. Aug 30 02:01:12.781579 dv-cinder-819667-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 02:01:12.782272 dv-cinder-819667-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 02:01:12.785722 dv-cinder-819667-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 02:01:12.800856 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 02:01:12 2022] *** Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: nodename: dv-cinder-819667-6-iscsi Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: machine: x86_64 Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: clock source: unix Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: pcre jit disabled Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: detected number of CPU cores: 4 Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: current working directory: / Aug 30 02:01:12.802873 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: detected binary path: /usr/bin/uwsgi-core Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: your processes number limit is 47680 Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: your memory page size is 4096 bytes Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: detected max file descriptor number: 2048 Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: lock engine: pthread robust mutexes Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: thunder lock: enabled Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 02:01:12.803641 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 02:01:12.843805 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: Python main interpreter initialized at 0x5619a3f799c0 Aug 30 02:01:12.843805 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: python threads support enabled Aug 30 02:01:12.843805 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: your server socket listen backlog is limited to 100 connections Aug 30 02:01:12.843805 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: your mercy for graceful operations on workers is 90 seconds Aug 30 02:01:12.844236 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 02:01:12.844236 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: *** Operational MODE: preforking *** Aug 30 02:01:12.844519 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: *** uWSGI is running in multiple interpreter mode *** Aug 30 02:01:12.844519 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: spawned uWSGI master process (pid: 121081) Aug 30 02:01:12.845315 dv-cinder-819667-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 02:01:12.846411 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: spawned uWSGI worker 1 (pid: 121093, cores: 1) Aug 30 02:01:12.846592 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: spawned uWSGI worker 2 (pid: 121094, cores: 1) Aug 30 02:01:12.846802 dv-cinder-819667-6-iscsi devstack@n-api.service[121081]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 02:01:13.524720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 02:01:13.553722 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 02:01:14.693239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 02:01:14.693239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: from cryptography.utils import int_from_bytes Aug 30 02:01:14.693958 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 02:01:14.693958 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: from cryptography.utils import int_from_bytes Aug 30 02:01:14.787736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 02:01:14.787736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: from cryptography.utils import int_from_bytes Aug 30 02:01:14.788352 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 02:01:14.788352 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: from cryptography.utils import int_from_bytes Aug 30 02:01:17.142616 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 02:01:17.143260 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 02:01:17.143800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 02:01:17.143800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 02:01:17.144005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 02:01:17.144388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.144746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.145049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.145374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.145881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.146202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.146531 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.146858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.147193 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.147458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.147788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.148113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-6-iscsi {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.148438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.148752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.149069 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.149651 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.149821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.150125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.150435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.150946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.152796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.153320 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.153672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.154033 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.154534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.155029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.155356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.155679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.156010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.156332 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.156781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-6-iscsi {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.157147 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.157437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.157787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.160769 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.161252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.161596 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.161915 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.162230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.162559 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.162873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.163184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.163438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.163754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.164079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.164408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.164735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.164987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.165244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.165595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.165922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.166237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.166548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.166860 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.167169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.167485 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.167797 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.168103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.168413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.168735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.169054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.169382 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.169716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.170041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.170449 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.170704 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.171015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.171367 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.171687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.171999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.172321 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.173395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.173968 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.174325 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.174645 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.174977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.175318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.175634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.175904 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.176208 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.176515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.176838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.177150 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.177484 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.177804 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.178110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.178422 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.178732 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.179044 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.179988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.179988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.179988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.180501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.180647 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.180847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.181170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.181634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.181826 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.182132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.182428 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.182740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.183061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.183370 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.183679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.184022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.184310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.184619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.184950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.185252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.185608 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.185933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.186235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.186545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.186863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.187175 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.187489 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.187796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.188679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.188980 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.189290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.189623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.189937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.190243 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.190582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.190890 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.191204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.191517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.191842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.192192 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.192485 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.192820 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.193168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.193503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.193841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.194203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.194492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.194810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.196308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.196308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.196308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.196308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.201701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.202963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.204431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.205692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.205692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.205692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.205692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.205692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.205692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.207202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.207202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.207202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.207202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.207202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.208527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.208527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.208527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.208527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.209303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.209303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.209303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.210137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.210137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.210448 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.210702 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.210999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.211166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.211441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.211753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.212070 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.212387 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.212703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.213014 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.213351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.213673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.213984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.214311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.214628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.214941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.215270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.215580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.215890 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.216214 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.216530 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.216845 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.217157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.218430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.218430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.218430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.219129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.219129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.219467 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.219669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.220062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.220314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.220687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.220933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.221232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.221567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.221878 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.222204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.222499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.222805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.223114 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.223422 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.223751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.224414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.224414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.224710 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.225084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.225324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.225669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.229864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.230535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.231073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.231073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.231309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.231640 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.231947 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.232267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.232610 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.232946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.233267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.233617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.233934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.234252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.234565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.235425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.235748 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.236080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.236478 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.236795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.237119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.237431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.237787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.238108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.238431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.238742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.239060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.239392 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.239728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.240044 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.240361 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.240686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.241054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.241369 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.241733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.242020 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.242863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.242863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.243035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.243244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.243558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.243865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.244183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.244495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.244805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.245111 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.245426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.245777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.246093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.247679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.247679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.247679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.247679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.247679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.248159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.248254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.248550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.248858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.249207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.249544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.249856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.250178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.250587 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.251553 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.252007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.252336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.252678 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.252987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.253308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.253653 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.253973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.254290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.254607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.254921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.255247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.255563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.255877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.256191 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.256501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.256816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.257136 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.257743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.258138 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.263589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.264854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.265324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.265569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.265828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.266225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.266617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.266933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.267246 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.267599 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.267917 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.268263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.268600 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.268950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.269261 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.269592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.269920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.270228 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.270536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.270842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.271157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.271469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.271775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.272089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.272400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.272712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.273023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.273332 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.273666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.273975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.274292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.274606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.274914 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.275253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.275584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.275897 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.276205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.276517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.276825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.277141 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.277445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.277775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.278086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.278401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.278714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.279023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.279347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.279663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.279969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.280276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.280588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.280893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.281200 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.281534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.281892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.282210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.282517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.282833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.283140 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.283449 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.283753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.284065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.284368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.284674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.284979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.285284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.285616 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.285942 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.286254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.286560 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.286937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.287221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.287564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.287874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.288239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.288546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.288863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.289189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.289527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.289843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.290161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.290465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.290784 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.291095 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.291410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.291713 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.292020 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.292344 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.292659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.292973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.293299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.293653 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.293979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.294287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.294600 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.294913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.295226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.295539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.295855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.296170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.296486 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.296822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.297121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.298101 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.298521 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.298856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.299202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.299502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.299833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.300149 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.300460 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.300777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.301091 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.301407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.301825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.302176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.302497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.302817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.303126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.303442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.303761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.304080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.304398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.304708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.305132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.305450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.305789 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.306105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.306417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.306724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.307038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.307366 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.307673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.307988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.308296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.308623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.308935 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.309417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.309710 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.310030 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.310339 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.310763 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.311079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.311394 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.311720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.312046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.312432 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.312681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.313088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.313409 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.313783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.314095 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.314412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.314734 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.315054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.315903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.316226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.316547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.316874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.317296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.317650 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.317971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.318299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.318634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.318949 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.319259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.319574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.319888 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.320197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.320524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.320844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.321247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.321528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.321848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.322157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.322468 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.322794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.323106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.323432 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.323751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.324079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.324404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.324717 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.325041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.325357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.325739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.326004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.326311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.326659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.326969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.327294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.327628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.327967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.328280 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.328641 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.328971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.329294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.329643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.329985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.330275 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.330580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.330894 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.331201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.331509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.331815 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.332128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.332489 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.332795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.333103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.333431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.333762 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.334087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.334420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.334713 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.335022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.335331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.335677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.335987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.336320 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.336635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.336960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.337280 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.337632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.337957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.338275 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.338612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.338911 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.339230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.339543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.339872 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.340183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.340501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.341060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.341400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.341761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.342082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.342405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.343009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.343305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.343625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.343944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.344306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.344609 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.344951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.345270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.345626 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.349838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.350620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.351250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.351250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.351250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.351539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.351828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.352173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.352502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.352823 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.353142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.353488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.354016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.354335 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.354668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.354995 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.355370 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.355712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.356037 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.356367 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.356679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.356989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.357306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.357652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.357970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.358296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.358612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.358923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.359246 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.359560 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.360697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.361051 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.361370 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.361725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.362056 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.362378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.362692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.363019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.363328 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.363640 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.363960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.364275 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.364585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.364892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.365207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.365544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.365855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.366168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.366474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.366805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.367144 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.367456 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.367764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.368082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.368396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.368704 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.369012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.369319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.369728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.370038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.370354 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.370666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.370981 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.371291 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.371605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.371968 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.372299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.372610 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.372990 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.373319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.373663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.373993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.374311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.374627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.374981 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.375303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.376398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.376878 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.377210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.377577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.377916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.378247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.378572 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.378882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.379212 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.379529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.379845 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.380159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.380476 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.380793 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.381105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.381418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.384874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.385174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.385413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.385753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.386067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.386384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.386698 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.387020 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.387354 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.387670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.387978 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.388413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.388733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.389053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.389377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.389715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.390041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.390363 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.390693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.391012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.391356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.391693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.392032 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.392361 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.392688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.393002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.393310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.393644 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.393962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.394285 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.394599 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.394905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.395212 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.395530 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.395917 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.396270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.396604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.396931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.397265 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.397649 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.397949 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.398295 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.398648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.398960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.399306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.399643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.399974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.400307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.400649 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.400985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.401316 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.401691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.402029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.402350 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.402675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.402989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.403314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.403627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.403951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.404274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.404597 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.404911 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.405245 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.405581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.405897 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.406210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.406524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.406933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.407270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.407604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.407935 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.408243 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.408578 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.408901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.409225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.409568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.409885 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.410217 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.410532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.410847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.411161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.411476 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.411789 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.412109 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.412424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.412738 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.413057 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.413377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.413734 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.414065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.414378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.414705 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.415034 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.415381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.415697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.416046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.416421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.416739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.417053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.417358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.417628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 02:01:17.480782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO dbcounter [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Registered counter for database nova_api Aug 30 02:01:17.501926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:17.508638 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writer thread running {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:17.567004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.context [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f5299b58-fdcd-461c-bb89-e110eb2a6931(cell1) {{(pid=121094) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 02:01:17.571339 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.571824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.573598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.574367 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:17.574810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:17.576972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:17.579219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO dbcounter [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Registered counter for database nova_cell0 Aug 30 02:01:17.583784 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO dbcounter [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Registered counter for database nova_cell1 Aug 30 02:01:17.591700 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:17.593446 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:17.600859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writer thread running {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:17.602167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writer thread running {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:17.658498 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 02:01:17.659078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 02:01:17.659263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 02:01:17.659623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 02:01:17.659875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 02:01:17.660259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.660589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.660911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.661228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.661709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.662023 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.662346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.662667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.662994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.663258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.663576 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.663901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819667-6-iscsi {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.664254 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.664727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.665250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.665820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.666326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.666864 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.667385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.668267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.668782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.669305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.669869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.670427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.670962 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.671496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.672038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.672649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.673148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.673724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.674398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819667-6-iscsi {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.674921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.675459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.676001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.676694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.677215 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.677569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.677906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.678242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.678561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.678908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.679237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.679563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.679889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.680197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.680508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.680821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.681144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.681467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.681784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.682036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.682347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.682669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.682988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.683309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.683562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.683811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.684130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.684451 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.684759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.685064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.685372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.685701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.686020 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.686311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.686615 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.686919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.687233 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.687546 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.687866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.688692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.689009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.689404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.689678 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.689986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.690326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.690644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.690943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.691263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.691585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.691893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.692196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.692500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.692818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.693154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.693476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.693796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.694096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.694400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.694716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.695023 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.695328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.695637 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.695934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.696238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.696540 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.696842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.697147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.697450 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.697771 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.698076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.698380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.698680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.698992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.699307 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.699635 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.700030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.700478 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.700853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.701212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.701554 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.701895 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.702270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.702585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.702926 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.703431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.704007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.704551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.705065 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.705608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.706131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.706648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.707167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.707691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.708207 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.708728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.709282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.709809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.710328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.710852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.711368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.711920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.712967 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.713529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.714054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.714577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.715129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 02:01:17.715702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.716220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.716581 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.716906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.717251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.717615 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.718195 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.718535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.718839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.719165 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.719526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.719839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.721620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.721620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.721620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.721620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.721620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.722168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.722168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.722363 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.722685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.723017 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.723340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.723652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.723994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.724340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.724657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.724982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.725308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.725646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.725960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.726272 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.726595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.726932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.727243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.727563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.727878 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.728198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.728511 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.728821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.729133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.729444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.729775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.730111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.730427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.730748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.731062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.731373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.731694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.732007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.732318 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.732629 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.732933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.733236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.733563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.733875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.734176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.734495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.734855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.735213 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.735551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.735859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.736184 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.736479 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.736789 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.737096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.737403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.737739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.738046 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.738368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.738677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.738985 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.739308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.739612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.739916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.740230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.740543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.740852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.741161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.741494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.741820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.742164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.742569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.742947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.743280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.743587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.743912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.744235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.744554 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.744860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.745310 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.745858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.746370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.746884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.747403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.748093 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.748435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.748964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.749588 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.750038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.751127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.751670 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.752179 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.752556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.752832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.753010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO dbcounter [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Registered counter for database nova_cell0 Aug 30 02:01:17.753192 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.753533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.753889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.754235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.754566 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.754898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.755387 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.755823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.756159 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.756428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.759885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.760156 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:17.760281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.760818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.761338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.761920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.762509 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.763081 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.763510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.763913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.764245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.764574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.764898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.765007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writer thread running {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:17.765219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.765627 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.766036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.767171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.767544 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.768063 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.768386 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.768826 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.769181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.769565 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.769974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.770397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.770847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.771244 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.771612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.772051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.772397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.772718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.773037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.773357 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.773698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.774013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.774331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.774656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.775473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.775473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.775749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.775900 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.776178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.776489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.776870 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.777344 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.777910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.778347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.778685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.779115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.779566 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.780088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.780634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.781164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.781759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.782293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.782823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.784507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.784507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.784507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.784996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.785385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.785737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.786070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.786394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.786715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.787046 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.787371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.787688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.788008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.788323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.788636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.788948 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.789274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.789630 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.789945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.790258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.790564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.790876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.791194 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.791910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.795824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.796587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.796587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.796587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.796587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.796587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.796587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.797415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.797415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.797415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.797901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.797901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.798287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.798610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.798935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.799379 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.799630 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.799939 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.800268 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.800585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.800901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.801202 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.801530 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.802043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.802200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.802515 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.802845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.803187 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.803495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.803797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.804118 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.804422 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.804725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.805030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.805342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.805673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.805977 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.806287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.806608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.806955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.807269 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.807574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.807883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.808188 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.808570 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.808881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.809190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.809512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.809825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.810134 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.810439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.810746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.811050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.811364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.811669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.811974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.812275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.812588 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.812899 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.813954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.818938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.819592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.819592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.819592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.819592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.819592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.819931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.820155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.820686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.821216 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.821773 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.822303 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.823073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.823176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.824280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.824280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.824280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.824733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.824885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.825180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.825514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.825885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.826197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.826518 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.826842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.827220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.827480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.827829 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.828235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.828788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.829505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.829873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.830387 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.830912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.831459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.831999 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.832539 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.833619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.834181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.834745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.835097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.835429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.835755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.836079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.836400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.836721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.837042 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.837363 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.837708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.838032 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.838346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.838659 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.838976 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.839293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.839601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.839934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.840249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.840555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.840967 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.841171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.841527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.841796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.842306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.842593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.843122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.843449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.843750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.844064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.844568 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.844901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.845220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.845655 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.845974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.846289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.846605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.846915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.847223 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.847535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.847862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.848169 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.848487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.848875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.849205 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.849612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.849943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.850367 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.850684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.850991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.851413 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.851729 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.852050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.852381 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.852703 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.853029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.853341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.853686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.854001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.854325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.854653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.854966 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.855287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.855595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.855919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.856243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.856572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.856915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.857390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.857770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.858181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.858716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.859247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.859758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.860794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.861308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.861841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.862358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.862901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.863415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.863948 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.864487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.865018 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.865564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.866089 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.866641 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.867168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.867720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.868259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.868814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.869361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.869920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.870480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.870872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.871199 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.871517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.871846 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.872198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.872514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.872847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.873186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.873543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.873865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.874204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.874540 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.874869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.875188 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.876091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.876407 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.876715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.877021 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.877377 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.877722 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.878041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.878344 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.878652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.878961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.879268 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.879595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.879903 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.880228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.880542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.880852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.881162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.881485 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.881838 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.882154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.882497 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.882800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.883125 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.883446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.883764 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.884088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.884437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.884758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.885076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.885393 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.885747 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.886067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.886384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.886701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.887264 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.887596 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.887913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.888228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.888543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.888859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.889173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.889516 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.889817 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.890127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.890439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.890768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.891131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.891467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.891809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.892312 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.892638 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.892955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.893270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.893659 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.893980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.894288 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.894602 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.894915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.895232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.895543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.895853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.896207 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.896721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.897263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.897801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.898325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.898859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.899407 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.899987 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.900543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.901085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.901660 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.902220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.902949 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.903286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.903630 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.903964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.904301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.904637 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.904969 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.905304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.905642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.905957 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.906274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.906589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.906940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.907436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.907750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.908064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.908385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.908700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.909326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.909704 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.910031 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.910366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.910700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.911022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.911336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.911667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.911993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.912293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.912611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.912928 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.913232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.913569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.913889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.914200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.914506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.914821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.915128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.915455 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.915760 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.916067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.916372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.916684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.916988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.917291 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.917624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.917964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.918285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.918786 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.919299 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.919802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.920324 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.920843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.921368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.921806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.922099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.923142 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.923649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.924176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.924703 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.925256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.925820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.926228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.926712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.927190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.927804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.928151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.928525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.929024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.929600 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.930118 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.930633 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.931155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.931711 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.932250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.932792 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.933332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.933894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.934439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.934968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.935504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.936041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.936451 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.936797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.937121 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.937443 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.937784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.938799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.939063 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.939337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.939670 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.939991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.940315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.940638 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.940961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.941269 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.941603 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.941917 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.942239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.942570 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.942890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.943325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.943626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.943943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.944264 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.944590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.944901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.945224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.945601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.945885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.946198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.946510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.946840 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.947183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.947512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.947901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.948139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.948446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.948753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.949067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.949384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.949718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.950022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.950325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.950636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.950942 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.951332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.951553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.951854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.952162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.952466 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.952773 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.953106 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.953444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.953739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.954047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.954354 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.954651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.954944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.955245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.955549 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.955863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.956167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.956498 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.956812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.957135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.957444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.957787 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.958099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.958418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.958738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.959057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.959366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.959698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.960008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.960318 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.960628 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.960936 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.961247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.961582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.961907 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.962232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.962542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.962864 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.963189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.963555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.963804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.964113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.964440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.964750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.965058 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.965390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.965687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.965994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.966301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.966613 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.966926 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.967242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.967559 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.969501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.969501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.969501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.969501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.969501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.970373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.970565 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.971137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.971672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.972202 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.972742 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.973275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 02:01:17.973698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 02:01:18.046043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO dbcounter [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Registered counter for database nova_api Aug 30 02:01:18.068079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:18.075671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writer thread running {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:18.090299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 02:01:18.097958 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 02:01:18.136149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.context [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f5299b58-fdcd-461c-bb89-e110eb2a6931(cell1) {{(pid=121093) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 02:01:18.140833 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.141955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.143836 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.144706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:01:18.145165 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:01:18.147617 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:01:18.149674 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO dbcounter [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Registered counter for database nova_cell0 Aug 30 02:01:18.153808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO dbcounter [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Registered counter for database nova_cell1 Aug 30 02:01:18.161810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:18.168069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:18.170373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writer thread running {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:18.171768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writer thread running {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:18.339063 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO dbcounter [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Registered counter for database nova_cell0 Aug 30 02:01:18.347473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 02:01:18.354106 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writer thread running {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 02:01:18.446970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 02:01:18.452993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-746ffc79-8c4a-44a7-bd52-682ed406f63e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 02:01:18.458432 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5619a3f799c0 pid: 121094 (default app) Aug 30 02:01:18.681802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 02:01:18.689816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 02:01:19.048295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 02:01:19.054348 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-fd498bd0-3ed1-4a0d-b861-c59a45665422 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 02:01:19.059621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5619a3f799c0 pid: 121093 (default app) Aug 30 02:01:55.277689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:55.278712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:55.279628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:55.280743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:56.437141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:56.438656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:56.440647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:56.441775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:01:56.796198 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63ade9c6-ce09-42f8-8e86-c64bf010eab0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Action: 'create', calling method: .version_select at 0x7f47374a9e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-857684951", "metadata": {"Type": "work"}}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63ade9c6-ce09-42f8-8e86-c64bf010eab0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Request method failure captured: Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 121 Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-TAfTAJuBNkA6SFNF1tnerYKwvhwhN48kZtmZNRTEz7j-mFWRea8ewu_-qw_pR8KxI6PcEv6t0UBVJd6wMek9yjQrccoWTPysfJcRtiew__MnuAfozBsT7HBtvIQPUJ4KZgE1j4ZqHjtxdw9AFwEEQl1VA4ecOwZnQta3rt0BolOg Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:01:56.803072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 8019b993d3b74f13ad20564a86f39ab3 Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-857684951", "metadata": {"Type": "work"}}} Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:01:56.804554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-857684951', 'metadata': {'Type': 'work'}}}} Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise error Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:01:56.805444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 02:01:56.806806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 02:01:56.807956 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 02:01:56.807956 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.809543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63ade9c6-ce09-42f8-8e86-c64bf010eab0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:01:56.811279 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-63ade9c6-ce09-42f8-8e86-c64bf010eab0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.546180 Aug 30 02:01:56.812198 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 02:01:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1549 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:01:56.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52470274-6459-401e-af1f-67fdaa01e685 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Action: 'create', calling method: .version_select at 0x7f473747c940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1100503529", "metadata": {"Type": "work"}}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52470274-6459-401e-af1f-67fdaa01e685 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Request method failure captured: Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 120 Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-TAfTAJuBNkA6SFNF1tnerYKwvhwhN48kZtmZNRTEz7j-mFWRea8ewu_-qw_pR8KxI6PcEv6t0UBVJd6wMek9yjQrccoWTPysfJcRtiew__MnuAfozBsT7HBtvIQPUJ4KZgE1j4ZqHjtxdw9AFwEEQl1VA4ecOwZnQta3rt0BolOg Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:01:56.836853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 8019b993d3b74f13ad20564a86f39ab3 Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1100503529", "metadata": {"Type": "work"}}} Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:01:56.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1100503529', 'metadata': {'Type': 'work'}}}} Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise error Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi '0' Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:01:56.846178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 02:01:56.847817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 02:01:56.849170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 02:01:56.849170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.849170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52470274-6459-401e-af1f-67fdaa01e685 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:01:56.849170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-52470274-6459-401e-af1f-67fdaa01e685 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012854 Aug 30 02:01:56.849170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 02:01:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:01:56.858103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f68ddca1-929c-4d5f-84ea-c20942acf9c0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Action: 'create', calling method: .version_select at 0x7f47373779d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-309982398", "metadata": {"Type": "work"}}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f68ddca1-929c-4d5f-84ea-c20942acf9c0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Request method failure captured: Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 118 Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-TAfTAJuBNkA6SFNF1tnerYKwvhwhN48kZtmZNRTEz7j-mFWRea8ewu_-qw_pR8KxI6PcEv6t0UBVJd6wMek9yjQrccoWTPysfJcRtiew__MnuAfozBsT7HBtvIQPUJ4KZgE1j4ZqHjtxdw9AFwEEQl1VA4ecOwZnQta3rt0BolOg Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:01:56.864873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 8019b993d3b74f13ad20564a86f39ab3 Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-309982398", "metadata": {"Type": "work"}}} Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:01:56.866317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-309982398', 'metadata': {'Type': 'work'}}}} Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise error Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi '' Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:01:56.867126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 02:01:56.868669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 02:01:56.871121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 02:01:56.871121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:56.871121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f68ddca1-929c-4d5f-84ea-c20942acf9c0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:01:56.871121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f68ddca1-929c-4d5f-84ea-c20942acf9c0 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012908 Aug 30 02:01:56.873163 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 02:01:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:01:56.901108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1b8a4614-7d4a-4faf-ac63-44bd210c5859 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Calling method '.version_select at 0x7f4737377700>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:57.561642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-abd7bb4c-4a07-4f06-b636-bcb900e64883 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Action: 'create', calling method: .version_select at 0x7f47374aaee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1911071997", "metadata": {"Type": "work"}}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:01:58.016747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-1b8a4614-7d4a-4faf-ac63-44bd210c5859 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] HTTP exception thrown: Volume tempest-invalid-1545461838 could not be found. Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1b8a4614-7d4a-4faf-ac63-44bd210c5859 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Request method failure captured: Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1545461838 HTTP/1.1 Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-TAfTAJuBNkA6SFNF1tnerYKwvhwhN48kZtmZNRTEz7j-mFWRea8ewu_-qw_pR8KxI6PcEv6t0UBVJd6wMek9yjQrccoWTPysfJcRtiew__MnuAfozBsT7HBtvIQPUJ4KZgE1j4ZqHjtxdw9AFwEEQl1VA4ecOwZnQta3rt0BolOg Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:01:58.019026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 8019b993d3b74f13ad20564a86f39ab3 Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Volume tempest-invalid-1545461838 could not be found. Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'tempest-invalid-1545461838'} Aug 30 02:01:58.020692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1545461838 could not be found. (HTTP 404) (Request-ID: req-b0ee0ac0-8123-40be-8aa1-b04542612e4b) Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.021761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:01:58.023241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1545461838 could not be found. Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:01:58.025443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1545461838 could not be found. Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1545461838 could not be found. Aug 30 02:01:58.027482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.031561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1b8a4614-7d4a-4faf-ac63-44bd210c5859 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Returning 404 to user: Volume tempest-invalid-1545461838 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:01:58.032753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1b8a4614-7d4a-4faf-ac63-44bd210c5859 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1545461838" status: 404 len: 99 microversion: 2.1 time: 1.147409 Aug 30 02:01:58.035182 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 02:01:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1545461838 => generated 99 bytes in 1155 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 02:01:58.044555 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-51aa6039-4a05-4aa9-9e53-70aed8002204 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004103 Aug 30 02:01:58.045854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 02:01:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 02:01:58.065314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b54dff59-f593-40ae-b2a8-6db1af1b54ba tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004709 Aug 30 02:01:58.065314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 02:01:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 02:01:58.071263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-81a3a477-70c4-49a1-bf26-21fde83140e1 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Calling method '.version_select at 0x7f47372b8ca0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-81a3a477-70c4-49a1-bf26-21fde83140e1 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] HTTP exception thrown: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-81a3a477-70c4-49a1-bf26-21fde83140e1 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Request method failure captured: Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: DELETE /compute/v2.1/os-volumes/57f0dabb-20c2-452d-ab42-aa3acca51eb0 HTTP/1.1 Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-TAfTAJuBNkA6SFNF1tnerYKwvhwhN48kZtmZNRTEz7j-mFWRea8ewu_-qw_pR8KxI6PcEv6t0UBVJd6wMek9yjQrccoWTPysfJcRtiew__MnuAfozBsT7HBtvIQPUJ4KZgE1j4ZqHjtxdw9AFwEEQl1VA4ecOwZnQta3rt0BolOg Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:01:58.315868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 8019b993d3b74f13ad20564a86f39ab3 Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '57f0dabb-20c2-452d-ab42-aa3acca51eb0'} Aug 30 02:01:58.651443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. (HTTP 404) (Request-ID: req-328f653b-5bfa-4aec-8088-d5e0a987c123) Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.658687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:01:58.664979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 02:01:58.668757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-81a3a477-70c4-49a1-bf26-21fde83140e1 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Returning 404 to user: Volume 57f0dabb-20c2-452d-ab42-aa3acca51eb0 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-81a3a477-70c4-49a1-bf26-21fde83140e1 tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/57f0dabb-20c2-452d-ab42-aa3acca51eb0" status: 404 len: 109 microversion: 2.1 time: 0.246825 Aug 30 02:01:58.676766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 7/7] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:01:58 2022] DELETE /compute/v2.1/os-volumes/57f0dabb-20c2-452d-ab42-aa3acca51eb0 => generated 109 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-be22888e-bfcb-4062-87c2-eb2307841eec tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Calling method '.version_select at 0x7f473731c790>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-be22888e-bfcb-4062-87c2-eb2307841eec tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] HTTP exception thrown: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-be22888e-bfcb-4062-87c2-eb2307841eec tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Request method failure captured: Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/os-volumes/f1d0a043-7865-4c00-9ebc-fd80c3091013 HTTP/1.1 Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-TAfTAJuBNkA6SFNF1tnerYKwvhwhN48kZtmZNRTEz7j-mFWRea8ewu_-qw_pR8KxI6PcEv6t0UBVJd6wMek9yjQrccoWTPysfJcRtiew__MnuAfozBsT7HBtvIQPUJ4KZgE1j4ZqHjtxdw9AFwEEQl1VA4ecOwZnQta3rt0BolOg Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:01:58.682869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c28e611dd60f47dbb3a396a2b59406c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c28e611dd60f47dbb3a396a2b59406c7 Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesNegativeTest-912735159 Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 8019b993d3b74f13ad20564a86f39ab3 Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesNegativeTest-912735159-project Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'f1d0a043-7865-4c00-9ebc-fd80c3091013'} Aug 30 02:01:58.687579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. (HTTP 404) (Request-ID: req-505b7c74-e626-48f1-bcb4-893b124af219) Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.689308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:01:58.693381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 02:01:58.697940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-be22888e-bfcb-4062-87c2-eb2307841eec tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] Returning 404 to user: Volume f1d0a043-7865-4c00-9ebc-fd80c3091013 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-be22888e-bfcb-4062-87c2-eb2307841eec tempest-VolumesNegativeTest-912735159 tempest-VolumesNegativeTest-912735159-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/f1d0a043-7865-4c00-9ebc-fd80c3091013" status: 404 len: 109 microversion: 2.1 time: 0.282380 Aug 30 02:01:58.700751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 8/8] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:01:58 2022] GET /compute/v2.1/os-volumes/f1d0a043-7865-4c00-9ebc-fd80c3091013 => generated 109 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:01:59.568871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-abd7bb4c-4a07-4f06-b636-bcb900e64883 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.142131 Aug 30 02:01:59.569847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 1/9] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 02:01:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3145 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 02:01:59.585618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-73cb268b-c862-44c7-939c-bbac9e331980 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Calling method '.version_select at 0x7f4737377310>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:01:59.706711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-73cb268b-c862-44c7-939c-bbac9e331980 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055" status: 200 len: 353 microversion: 2.1 time: 0.126168 Aug 30 02:01:59.713076 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 9/10] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:01:59 2022] GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:00.721702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c09ff448-ad8f-472b-a3e5-a062168eaa09 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Calling method '.version_select at 0x7f473732bd30>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:00.827938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c09ff448-ad8f-472b-a3e5-a062168eaa09 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055" status: 200 len: 354 microversion: 2.1 time: 0.111256 Aug 30 02:02:00.828983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 2/11] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:02:00 2022] GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:00.842104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aa932ca4-e3cc-45b3-8bdc-6e3772d6dad3 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Calling method '.version_select at 0x7f47372b83a0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:00.961757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aa932ca4-e3cc-45b3-8bdc-6e3772d6dad3 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055" status: 200 len: 354 microversion: 2.1 time: 0.123648 Aug 30 02:02:00.963234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 10/12] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:02:00 2022] GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:00.986623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bea6358f-382b-4997-9182-168d04bf96f6 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Calling method '.version_select at 0x7f4737344430>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:01.335049 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bea6358f-382b-4997-9182-168d04bf96f6 tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055" status: 202 len: 0 microversion: 2.1 time: 0.354384 Aug 30 02:02:01.336135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 3/13] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:02:00 2022] DELETE /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:02:01.345547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-829c6f38-32da-49d7-8d35-4feb66c3e61c tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Calling method '.version_select at 0x7f4737254160>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:01.552618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-829c6f38-32da-49d7-8d35-4feb66c3e61c tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055" status: 200 len: 353 microversion: 2.1 time: 0.211958 Aug 30 02:02:01.554217 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 11/14] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:02:01 2022] GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:02.567316 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-96c7e687-2b90-4d5b-abfb-39f2e5646d7d tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Calling method '.version_select at 0x7f4737344af0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:02.645378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-96c7e687-2b90-4d5b-abfb-39f2e5646d7d tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] HTTP exception thrown: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-96c7e687-2b90-4d5b-abfb-39f2e5646d7d tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Request method failure captured: Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 HTTP/1.1 Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-UB918tSk_DWkwUV0K4nwKyMHbWoBz05f_i_oPjIK0uoPeCIxeagzBSiNo4AcGaJMpR68vyAuUz9TdAboSJFa_HHRNrzEiUgUm5GouETKUo_UJ2VrsKzMNIrqXQ5tJibkHEitHq2-U9rmzxgmjBYNv_kjU1xamyx2jctvLOdLYOMg Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: bacfc2716dad4ad991b56e781f2d05ef Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-VolumesGetTestJSON-793646979 Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:02:02.655893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bacfc2716dad4ad991b56e781f2d05ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bacfc2716dad4ad991b56e781f2d05ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bacfc2716dad4ad991b56e781f2d05ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bacfc2716dad4ad991b56e781f2d05ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-VolumesGetTestJSON-793646979 Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: bacfc2716dad4ad991b56e781f2d05ef Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-VolumesGetTestJSON-793646979 Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-VolumesGetTestJSON-793646979-project Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 9bb1df3fe2214e9da8e72b1047d569f2 Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-VolumesGetTestJSON-793646979-project Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '61affe4e-466a-488c-a38a-d0aa52273055'} Aug 30 02:02:02.657210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. (HTTP 404) (Request-ID: req-cf99870c-30f8-4a37-80f4-a01f9cf5e50d) Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:02:02.658138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:02:02.659256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 02:02:02.660117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-96c7e687-2b90-4d5b-abfb-39f2e5646d7d tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] Returning 404 to user: Volume 61affe4e-466a-488c-a38a-d0aa52273055 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-96c7e687-2b90-4d5b-abfb-39f2e5646d7d tempest-VolumesGetTestJSON-793646979 tempest-VolumesGetTestJSON-793646979-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055" status: 404 len: 109 microversion: 2.1 time: 0.094544 Aug 30 02:02:02.661224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 4/15] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:02:02 2022] GET /compute/v2.1/os-volumes/61affe4e-466a-488c-a38a-d0aa52273055 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:02:08.918556 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2026161840", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "networks": [{"uuid": "050b1da9-475b-4ee9-8160-4c67d0f493ca"}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:09.179970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] validate_networks() for [('050b1da9-475b-4ee9-8160-4c67d0f493ca', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:02:11.649819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:02:11.650468 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:02:11.650694 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:02:11.651091 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:02:11.651663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:02:11.679930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:11.680668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:11.681244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:11.682311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:11.684141 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:11.698162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:11.799011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Getting quotas for project bf405bc0c4b5454aa2b868e9cb5fc7e1. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:11.825148 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Getting quotas for user 44f9cfa0ebb84922a9af96ba030ee57a and project bf405bc0c4b5454aa2b868e9cb5fc7e1. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:11.853358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:02:11.861560 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:02:11.995220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1303033239", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:12.137739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-69f0e722-4214-4b1b-b735-edd1c54a4687 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.792026 Aug 30 02:02:12.147252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 12/16] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:02:12.182129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-29273d3d-7f89-4ad2-8353-cfd846672770 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:12.182752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-29273d3d-7f89-4ad2-8353-cfd846672770 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:12.190482 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] validate_networks() for [('1d16cb49-ecef-4189-a61f-53bbf0aaef30', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:02:12.863216 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-29273d3d-7f89-4ad2-8353-cfd846672770 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:12.895795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-29273d3d-7f89-4ad2-8353-cfd846672770 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1215 microversion: 2.1 time: 0.728296 Aug 30 02:02:12.897320 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 13/17] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:12 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1215 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:13.928336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-215a456e-5699-4fdf-a56b-2b2d8c4c99c3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:13.929679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-215a456e-5699-4fdf-a56b-2b2d8c4c99c3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:13.932759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:02:13.933400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:02:13.938469 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:02:13.939517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:02:13.940247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:02:14.014765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:14.015493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:14.016080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:14.016970 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:14.017974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:14.019297 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:14.172672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for project e7f4b9bbe0b640688754d04484900cca. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:14.198177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for user 5e7584fe83684b01baa31ab67edac026 and project e7f4b9bbe0b640688754d04484900cca. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:14.230416 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:02:14.239951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:02:14.268886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-215a456e-5699-4fdf-a56b-2b2d8c4c99c3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:14.329661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-215a456e-5699-4fdf-a56b-2b2d8c4c99c3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1215 microversion: 2.1 time: 0.415424 Aug 30 02:02:14.331516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 14/18] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:13 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1215 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:14.573128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-725b1038-ebb3-416c-a693-5162573e67c6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.851268 Aug 30 02:02:14.576785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 5/19] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:02:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:02:14.593220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-758accc8-8c86-463b-9dc8-5f00d0bacd6f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:14.593943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-758accc8-8c86-463b-9dc8-5f00d0bacd6f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:14.979853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-758accc8-8c86-463b-9dc8-5f00d0bacd6f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:14.990006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-758accc8-8c86-463b-9dc8-5f00d0bacd6f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1222 microversion: 2.1 time: 0.403409 Aug 30 02:02:14.991465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 15/20] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:14 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1222 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:15.827081 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-718c7fdb-b6d7-4980-b8a3-35938fd5be38 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: .version_select at 0x7f47369be430>, body: {"keypair": {"name": "tempest-keypair-1960565659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKrOIhVwhUbN8yAIZDObHOpj7stXF2lEAuOJTth9T2niCY8J+UUZSrSiBo7Kzc/W9s/iJMLvtsC4VSX8dFs1wTu+g6WFJRwuTY9vPyO+ChV4tSPbNF0GhbGwl669dx1CA=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:15.840245 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b4c241f6-7fc6-421c-8107-c5494f7605e3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: .version_select at 0x7f4736984940>, body: {"keypair": {"name": "tempest-keypair-922006313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEJ+nJxt+Dt0AB7mIfWqPzEjU/5Y0zw/L4Z+IDrKq7NiDQRVTCYjAcCb9ixcsaneIJ9rW0pSe7IBeumM2CGXo7pxmR4mRl+7lVxvqhdGd/xFQwNEIvK5LdUzylL5/pDcA=="}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:15.876044 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-b4c241f6-7fc6-421c-8107-c5494f7605e3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:15.881684 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-b4c241f6-7fc6-421c-8107-c5494f7605e3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:15.886551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-718c7fdb-b6d7-4980-b8a3-35938fd5be38 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:15.891973 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-718c7fdb-b6d7-4980-b8a3-35938fd5be38 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for user bda980735a1f4948ba695e6c2788f3b4 and project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:16.093841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-718c7fdb-b6d7-4980-b8a3-35938fd5be38 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.097512 Aug 30 02:02:16.103597 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b4c241f6-7fc6-421c-8107-c5494f7605e3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.788435 Aug 30 02:02:16.104315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 6/21] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:02:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:16.107469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 16/22] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:02:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:16.127334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:16.127987 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:16.139794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-738671388", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:16.173398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.174163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.183652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.183652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.183652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.183652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.271877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] validate_networks() for [('1d16cb49-ecef-4189-a61f-53bbf0aaef30', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:02:16.391820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:16.416091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f184863b-d5ba-41e1-b1d9-4741e50024f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1219 microversion: 2.1 time: 0.310036 Aug 30 02:02:16.416838 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 7/23] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:16 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1219 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:16.943759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:02:16.944383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:02:16.944986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:02:16.945652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:02:16.946330 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:02:16.962310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.962795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.963232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.964164 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:16.964636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:16.965059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:16.986850 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for project e7f4b9bbe0b640688754d04484900cca. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:16.994291 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for user 5e7584fe83684b01baa31ab67edac026 and project e7f4b9bbe0b640688754d04484900cca. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:17.012709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:02:17.016754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:02:17.290053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e10e8cea-1d89-4942-a787-454408f4e9b8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.168526 Aug 30 02:02:17.291885 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 17/24] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:02:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:02:17.302452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ef00f550-c04b-4d19-9f39-3662929d915b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:17.303606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ef00f550-c04b-4d19-9f39-3662929d915b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:17.441404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:17.442368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:17.449656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.450416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.451106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.452075 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:17.452785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:17.453435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:17.671667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ef00f550-c04b-4d19-9f39-3662929d915b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:17.693405 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ef00f550-c04b-4d19-9f39-3662929d915b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1221 microversion: 2.1 time: 0.394696 Aug 30 02:02:17.698766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 8/25] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:17 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1221 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:17.800704 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:17.822414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-933e34d5-5a7d-4460-8fb0-f45396c74d3d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1267 microversion: 2.1 time: 0.384547 Aug 30 02:02:17.843547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 18/26] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:17 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1267 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:18.724323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3bf94e02-7829-4a45-b83c-dd4585930a49 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:18.724954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3bf94e02-7829-4a45-b83c-dd4585930a49 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:18.846022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:18.848919 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:18.866827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3bf94e02-7829-4a45-b83c-dd4585930a49 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:18.868913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.870857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.871727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.873828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:18.876693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:18.878634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:18.880917 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3bf94e02-7829-4a45-b83c-dd4585930a49 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1221 microversion: 2.1 time: 0.165967 Aug 30 02:02:18.884569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 9/27] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:18 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:19.389987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:19.399565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3287194e-4966-45d9-974f-99bbe77ea795 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1273 microversion: 2.1 time: 0.558617 Aug 30 02:02:19.409088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 19/28] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:18 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1273 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:19.914038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:19.914658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:19.923299 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:19.932328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:19.937073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:19.937073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:19.937073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:19.937536 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:20.089350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:20.103570 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cbb1b80a-0535-4b56-b8f5-2f430c0d71eb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1217 microversion: 2.1 time: 0.190309 Aug 30 02:02:20.108992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 10/29] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:19 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:20.427022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:20.428084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:20.440080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:20.443941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:20.444472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:20.445703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:20.448033 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:20.448773 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:20.827455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:20.837780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-537382b0-a8be-4aad-b15d-b86690207262 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1273 microversion: 2.1 time: 0.417049 Aug 30 02:02:20.842881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 20/30] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:20 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1273 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:21.136819 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:21.137481 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:21.159747 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:21.174551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:21.175362 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:21.176626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:21.180553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:21.181202 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:21.407970 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:21.429256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f14916ad-27ce-423d-b508-f87b90a7327b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1273 microversion: 2.1 time: 0.285117 Aug 30 02:02:21.429256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 11/31] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:21 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:21.865830 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:21.866549 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:21.891248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:21.891248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:21.891248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:21.891248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:21.893128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:21.896471 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:22.504174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:22.505607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:22.505607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:22.506488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-892cabd1-a8bd-4c04-8717-6d0812120bfd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.596794 Aug 30 02:02:22.506488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 21/32] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:21 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:22.506713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:22.506713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:22.506713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:22.506713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:22.507119 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:22.507119 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:23.158234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-496388184", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "594c7eaa-27eb-44bb-b03b-2139d7485cc6"}], "security_groups": [{"name": "tempest-securitygroup--1314059346"}], "key_name": "tempest-keypair-1960565659", "user_data": "}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:23.232192 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:23.246062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-aa9413df-de95-42ee-898a-adea3eba79f3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1291 microversion: 2.1 time: 0.799216 Aug 30 02:02:23.258739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 12/33] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:22 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1291 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:23.526483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:23.530616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:23.542424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:23.543476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:23.544366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:23.546572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:23.555951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:23.559851 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:23.808803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] validate_networks() for [('594c7eaa-27eb-44bb-b03b-2139d7485cc6', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:02:24.085830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:24.350909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:24.382134 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5558c71d-d207-4d7e-8ca1-13fdee95d610 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.853885 Aug 30 02:02:24.395772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 13/34] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:23 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:24.415729 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:24.417161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:24.440697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:24.444887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:24.448661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:24.448661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:24.450925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:24.452657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:24.713776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:24.735606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7b9b3aed-0d44-4aef-8ddd-5f3f1b8835a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1279 microversion: 2.1 time: 0.334576 Aug 30 02:02:24.739911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 14/35] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:24 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1279 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:25.415064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:25.416072 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:25.439076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:25.442198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:25.442787 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:25.445100 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:25.446331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:25.449147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:25.891529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:25.924732 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8cd1730b-9632-45e5-b9d4-eaec290a59f2 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.516163 Aug 30 02:02:25.940590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 15/36] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:25 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:25.954056 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-666854947", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316431ff-b22a-409c-830b-a78363ccfbd0"}], "security_groups": [{"name": "tempest-securitygroup--136216416"}], "key_name": "tempest-keypair-922006313", "user_data": "}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:26.438066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] validate_networks() for [('316431ff-b22a-409c-830b-a78363ccfbd0', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:02:26.839554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:02:26.840841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:02:26.841622 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:02:26.842530 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:02:26.843130 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:02:26.865546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:26.875055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:26.875055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:26.875055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:26.875055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:26.875449 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:26.916699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:26.922356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for user bda980735a1f4948ba695e6c2788f3b4 and project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:26.935976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:02:26.938991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:02:27.095504 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3ddc3aea-9a20-4514-b52f-8d1163a6fafc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.945798 Aug 30 02:02:27.099759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 22/37] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:02:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 3951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:02:27.111912 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:27.113335 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:27.130900 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.133106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.133730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.134357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.137675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.139480 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.319206 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:27.366471 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bbfafbc6-99ac-44da-9e5e-db07c46da16e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1279 microversion: 2.1 time: 0.263277 Aug 30 02:02:27.373652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 23/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:27 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:27.390558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:27.391405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:27.432433 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.432955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.433440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.441010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:27.444222 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:27.444994 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:27.998445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:28.007404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ba45bb3d-926c-4434-87fa-f1931ebb0000 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.632210 Aug 30 02:02:28.022300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 24/39] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:27 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:28.022300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0b2b4743-9f1f-46cf-8544-dd821abe2f12 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:28.022300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0b2b4743-9f1f-46cf-8544-dd821abe2f12 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:28.070774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0b2b4743-9f1f-46cf-8544-dd821abe2f12 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:28.080670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0b2b4743-9f1f-46cf-8544-dd821abe2f12 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1237 microversion: 2.1 time: 0.068918 Aug 30 02:02:28.081604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 25/40] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:28 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:28.402411 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:28.405308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:28.424352 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:28.426500 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:28.428669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:28.430260 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:28.431823 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:28.434672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:28.639476 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:28.648104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-02f10b30-539e-4cdc-80ff-255fd3a84f3f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1279 microversion: 2.1 time: 0.250189 Aug 30 02:02:28.648825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 26/41] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:28 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:28.882009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=14 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:29.456841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0990f725-df36-4f5e-902f-80f670f7e865", "tag": "3028796a-2cf7-481a-af93-2e8ba3d0be57"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:29.528092 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:29.528092 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:29.528092 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:29.644511 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Creating event network-changed:3028796a-2cf7-481a-af93-2e8ba3d0be57 for instance 0990f725-df36-4f5e-902f-80f670f7e865 on hv-cinder-81966 Aug 30 02:02:29.647522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 02:02:29.650080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-35c457ca-f098-4cb0-ba44-a24d481c1780 req-11ba5ab9-271d-425b-99cb-fad7ddf15452 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 02:02:29.651866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:29.653234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:29.653817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:29.654643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:29.655090 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:29.662623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:29.689352 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.compute.rpcapi [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 02:02:29.690310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] Releasing lock "compute-rpcapi-router" {{(pid=121094) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 02:02:29.727137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-faf7c916-3e33-4d10-9c68-44e412b6f339 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.076154 Aug 30 02:02:29.728055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 27/42] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:29.745710 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:29.751716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:29.783592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:29.787871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:29.788608 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:29.789993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:29.790815 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:29.791561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.258238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:02:30.258765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:02:30.259217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:02:30.261611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:02:30.265924 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:02:30.283341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:30.292504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.293129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.293804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.299643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.299643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.299643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.302744 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d98b161d-35a2-4de1-b44e-1072869604b3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.561622 Aug 30 02:02:30.303391 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 28/43] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:29 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:30.329669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:30.329669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:30.348665 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.349156 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.349623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.350339 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.354374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:02:30.364036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:02:30.364209 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.364209 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.383913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:02:30.390341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:02:30.651526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-35024c41-8b66-4d21-adaf-309d060336c1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.709394 Aug 30 02:02:30.658124 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 16/44] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:02:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 4716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:02:30.671954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:30.672890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:30.679900 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.680666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.689160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.689160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:30.689160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:30.689160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:30.869215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:30.896800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1a4dd931-392b-41e5-8fef-03970a703116 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1233 microversion: 2.1 time: 0.591971 Aug 30 02:02:30.902379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 29/45] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:30 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1233 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:31.585420 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:31.594065 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fd535f09-6c7b-4cd4-bed7-a3329eaaf91f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.934522 Aug 30 02:02:31.608035 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 17/46] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:30 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:31.612757 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c008e58f-3c51-452c-b9d5-d57918641a8d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:31.618968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c008e58f-3c51-452c-b9d5-d57918641a8d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:31.830914 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-8423971e-34ae-4a1a-ac75-a8a0a5932672 req-ecf5bd85-7d81-4dc3-9fc9-20c59052052d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a817aa2c-97a9-4aa6-bb24-95caeb130e67", "tag": "61565fda-094d-4fe4-931b-8cf82b3d145d"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:31.855534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:31.862371 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-8423971e-34ae-4a1a-ac75-a8a0a5932672 req-ecf5bd85-7d81-4dc3-9fc9-20c59052052d service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:31.863199 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-8423971e-34ae-4a1a-ac75-a8a0a5932672 req-ecf5bd85-7d81-4dc3-9fc9-20c59052052d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:31.864976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-8423971e-34ae-4a1a-ac75-a8a0a5932672 req-ecf5bd85-7d81-4dc3-9fc9-20c59052052d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:31.890758 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-8423971e-34ae-4a1a-ac75-a8a0a5932672 req-ecf5bd85-7d81-4dc3-9fc9-20c59052052d service nova] Creating event network-changed:61565fda-094d-4fe4-931b-8cf82b3d145d for instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 on hv-cinder-81966 Aug 30 02:02:31.902037 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-8423971e-34ae-4a1a-ac75-a8a0a5932672 req-ecf5bd85-7d81-4dc3-9fc9-20c59052052d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.995720 Aug 30 02:02:31.904452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 30/47] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:31.912747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:31.913934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:31.923744 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:31.925765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:31.926428 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:31.927857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:31.928501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:31.929181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:31.931989 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c008e58f-3c51-452c-b9d5-d57918641a8d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:31.953745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c008e58f-3c51-452c-b9d5-d57918641a8d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1240 microversion: 2.1 time: 0.340264 Aug 30 02:02:31.958066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 18/48] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:31 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1240 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:31.979501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:31.980252 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:31.996477 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:31.996954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:32.006938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:32.007351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:32.012251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:32.012982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:32.346293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:32.379853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-97049f79-6ac5-436f-9b3f-4c29c5f19b75 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1297 microversion: 2.1 time: 0.420319 Aug 30 02:02:32.386548 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 19/49] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:31 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1297 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:32.632211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:32.633758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:32.639550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:32.649783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a97322e1-1545-4b2e-b888-d62416efc580 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.743939 Aug 30 02:02:32.653989 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:32.654955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 31/50] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:31 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:32.655790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:32.656549 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:32.657536 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:32.658298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:32.659041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:32.915640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:32.930536 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-31e75c9b-e701-4abd-ba71-900930b4e637 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.302041 Aug 30 02:02:32.932979 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 20/51] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:32 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:32.981046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d5d4d9b6-4606-4544-88ae-594befaa5d34 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:32.983127 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d5d4d9b6-4606-4544-88ae-594befaa5d34 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:33.048401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d5d4d9b6-4606-4544-88ae-594befaa5d34 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:33.056282 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d5d4d9b6-4606-4544-88ae-594befaa5d34 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1240 microversion: 2.1 time: 0.080274 Aug 30 02:02:33.057210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 32/52] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:32 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:33.419522 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:33.420133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:33.426476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.426891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.427867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.428222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.428890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.429492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.563035 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:33.579202 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b75843a9-1089-4b8e-aaf8-17dc807d0c71 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1295 microversion: 2.1 time: 0.164173 Aug 30 02:02:33.581406 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 21/53] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:33 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:33.680719 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:33.681952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:33.696920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.697810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.710215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.711282 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.711913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.712508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.958219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cecad39-31d7-4dc6-a7b7-9c759be0732c", "tag": "4fe22a1d-4332-4831-ab82-7f45c452f699"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:33.978004 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:33.978776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:33.979652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:33.987283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:33.997331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-def3a4bd-fb92-4943-835f-168c5ff4c24c tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.323640 Aug 30 02:02:33.997942 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 33/54] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:33 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:34.007924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:34.010811 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:34.013223 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Creating event network-changed:4fe22a1d-4332-4831-ab82-7f45c452f699 for instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c on hv-cinder-81966 Aug 30 02:02:34.015155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121093) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 02:02:34.018119 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-31e60538-b285-447e-b8ed-3aaf8aaf94c2 req-e698cacb-0fa8-4f7b-8559-9bd08a338623 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121093) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 02:02:34.022542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.025524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.025928 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.033404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.034012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.038216 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.041074 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.041607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.042050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.042765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.043466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.043910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.061563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.compute.rpcapi [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 02:02:34.064605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] Releasing lock "compute-rpcapi-router" {{(pid=121093) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 02:02:34.122598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4c7e64dc-c389-4d74-9508-f30ea4c004ce None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171558 Aug 30 02:02:34.130961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 22/55] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:34.155256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:34.167798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:34.193013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.193969 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.196118 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.197607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.201170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.201802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.451446 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:34.465518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-517f1bcc-6a17-4dfe-902f-8ecc7748be35 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.460712 Aug 30 02:02:34.466482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 34/56] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:33 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:34.476333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:34.492751 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-26b96c64-4446-4c09-a6a1-0c67fdc1dba4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1244 microversion: 2.1 time: 0.358784 Aug 30 02:02:34.498566 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 23/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:34 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1244 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:34.604416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:34.605322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:34.616026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.619000 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.619689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.621188 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:34.624595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:34.626570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:34.989085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:35.022473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:35.024254 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:35.034751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-cdb0fb73-8f7e-4ed8-a48d-6b0a4aba332e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.414388 Aug 30 02:02:35.042557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 35/58] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:34 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:35.057295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:35.062007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:35.068003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.071231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:35.071735 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:35.072177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.449660 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:35.459187 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8b7a0c65-5ed4-4aed-844c-534d29ec53b7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.442927 Aug 30 02:02:35.462147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 24/59] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:35 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:35.510786 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:35.511408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:35.521539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:35.522076 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:35.522467 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.523180 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:35.523633 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:35.524143 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.526457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:35.528762 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:35.535875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:35.536366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:35.536827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.537619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:35.538231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:35.538920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:35.638867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:35.651913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-60b277fa-c25a-4cea-a352-a66af3e09962 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1292 microversion: 2.1 time: 0.129843 Aug 30 02:02:35.652969 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 25/60] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:35 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1292 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:35.800524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:35.800524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3d3aeeb7-d934-4b3f-a4ce-e9c21bcd3cad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.269693 Aug 30 02:02:35.800524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 36/61] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:35 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:36.066669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:36.067281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:36.073605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.074205 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.074702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.075473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.075929 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.076354 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.213099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:36.222662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1d3153d5-4b26-4d5e-bf6b-f1f2656e30b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.159750 Aug 30 02:02:36.224243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 26/62] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:36 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:36.487838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:36.487838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:36.490785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.493000 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.493817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.495637 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.498200 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.499946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.548481 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:36.674189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:36.674800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:36.682024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.683204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.684453 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.685367 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.686322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.686931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.692721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:36.809722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:36.818038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bd5ecd11-d010-4f8b-87cb-7e2153b0a133 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.340023 Aug 30 02:02:36.818625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 37/63] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:36 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:36.836110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:36.837074 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:36.844045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.844913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.845822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:36.847431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:36.847973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:36.848596 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.026178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:37.033875 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:37.040097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d6fe3784-883c-4f8e-bd62-04fe1937fa43 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1292 microversion: 2.1 time: 0.366714 Aug 30 02:02:37.040732 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 27/64] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:36 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1292 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:37.045338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9759581b-5148-465f-b2cb-6f907682d336 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.211510 Aug 30 02:02:37.045338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 38/65] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:36 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:37.245654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:37.247791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:37.254727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.254832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.255315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.256028 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.256476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.257077 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.474421 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:37.483392 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-17d0c47d-7451-481a-9bfc-2212effd337f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.242508 Aug 30 02:02:37.483959 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 28/66] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:37 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:37.854937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:37.860347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:37.862942 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.863426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.863858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.864626 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.865102 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.865548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.898413 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-744252e3-b5c3-4ec5-8183-bc27f630d70b req-e8b19108-5beb-4aed-9102-44c6ae298d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf23d31-4c2f-4ae6-98c5-bc5ad966309b", "tag": "0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:37.920551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-744252e3-b5c3-4ec5-8183-bc27f630d70b req-e8b19108-5beb-4aed-9102-44c6ae298d13 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:37.922403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-744252e3-b5c3-4ec5-8183-bc27f630d70b req-e8b19108-5beb-4aed-9102-44c6ae298d13 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:37.923071 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-744252e3-b5c3-4ec5-8183-bc27f630d70b req-e8b19108-5beb-4aed-9102-44c6ae298d13 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:37.940662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-744252e3-b5c3-4ec5-8183-bc27f630d70b req-e8b19108-5beb-4aed-9102-44c6ae298d13 service nova] Creating event network-changed:0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55 for instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b on hv-cinder-81966 Aug 30 02:02:37.946414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-744252e3-b5c3-4ec5-8183-bc27f630d70b req-e8b19108-5beb-4aed-9102-44c6ae298d13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051506 Aug 30 02:02:37.947095 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 29/67] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:02:38.066817 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:38.072684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:38.079191 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.080009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.080661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.081800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.082467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.083177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.096671 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:38.119783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-141976d2-6d56-4ee4-993b-91c032309899 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.281657 Aug 30 02:02:38.120875 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 39/68] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:37 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:38.138620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:38.147524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:38.147524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.147524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.148448 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.149304 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.150029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.150665 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.237340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:38.247565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-48832b15-f1bc-4c71-bfd7-50b92f12a2be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1292 microversion: 2.1 time: 0.125393 Aug 30 02:02:38.248299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 40/69] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:38 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1292 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:38.342652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:38.353797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7fb23b5c-fbac-4385-a0bd-bedbe9339850 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.293088 Aug 30 02:02:38.360489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 30/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:38 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:38.505444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:38.506474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:38.513254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.513859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.514457 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.515175 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:38.515618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:38.516126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:38.660919 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:38.670239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7956cee1-0ec7-4ad7-a180-c9da7488def3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.168596 Aug 30 02:02:38.671377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 41/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:38 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:39.140230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:39.141027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:39.151368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:39.153214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.153770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.154210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.154928 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.155388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.155801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.272931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:39.273674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:39.281801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.282408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.282893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.283801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.284414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.285624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.410033 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:39.416346 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:39.421607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0eaff9c6-e5d0-4929-a930-e45fa04941e8 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.285137 Aug 30 02:02:39.422196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 31/72] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:39 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:39.427177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:39.433016 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:39.433232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-383753df-ad9d-48bf-8d78-b68f507d3012 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1310 microversion: 2.1 time: 0.164610 Aug 30 02:02:39.433232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 42/73] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:39 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1310 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:39.442564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.443061 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.443494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.444198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.444652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.445078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.644777 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:39.654601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-215e9019-c3eb-4e4f-a895-c4d729b04626 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.231106 Aug 30 02:02:39.657273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 32/74] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:39 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:39.695458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:39.696309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:39.709338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=8 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:39.723662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.725278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.730569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.731395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:39.732302 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:39.733532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:39.989580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:40.000673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f41c02e3-8392-46f1-9bf6-6f9efdab6453 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.308937 Aug 30 02:02:40.001524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 43/75] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:39 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:40.576006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:40.576006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:40.577707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:40.577707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:40.578412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.578412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.578412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.578412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.578665 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.578665 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.578783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.578783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.578783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.578783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.579019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.579019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.690708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:40.705194 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b4ba6540-514f-4a14-bf1a-bd2da9317169 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.262338 Aug 30 02:02:40.729066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 33/76] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:40 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:40.735791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:40.736753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:40.743274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.743855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.744375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.745220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:40.746891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:40.747932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:40.840699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:40.853733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a94040fa-46d1-4ac2-a3b4-73b41a7fbc76 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.403444 Aug 30 02:02:40.854319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 44/77] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:40 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:40.957243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:40.967338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a8bc63d0-627d-48ff-8b48-e7c3706e3514 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.235697 Aug 30 02:02:40.968417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 34/78] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:40 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:41.028314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:41.030417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:41.041725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.043227 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.044225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.046603 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.048603 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.049419 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.234087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:41.241996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bddbdeb8-adae-4783-952e-7a0f711e3312 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.221651 Aug 30 02:02:41.242569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 45/79] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:41 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:41.726723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:41.729366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:41.737842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.738259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.738687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.741400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.743457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.744070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.878395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:41.879636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:41.892677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.895488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.897931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.899751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:41.918439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:41.918439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:41.949206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=8 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:42.059215 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:42.069804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-50b549d3-3d9b-4735-ab4b-b451224b297b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.346704 Aug 30 02:02:42.086973 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 35/80] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:41 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:42.095006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:42.095737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:42.107285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.107789 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.108231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.108949 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.109410 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.109860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.283177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:42.297952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:42.298519 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4095af40-43a5-42fa-a6a5-3e669978f798 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.210158 Aug 30 02:02:42.299502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 36/81] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:42 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:42.305855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:42.307084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:42.314204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fb4ce72c-a354-4d43-8b97-556a98b301fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.440421 Aug 30 02:02:42.316271 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 46/82] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:41 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:42.316643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.317853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.318356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.319083 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.319919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.320348 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.468210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:42.476561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3f980909-f323-4aac-ad02-400c354ac001 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.175852 Aug 30 02:02:42.477549 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 37/83] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:42 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:42.526019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-06e27a14-6e36-44f6-8f38-a4cff67394d0 req-42b38d8b-41c8-4be6-a6bc-395897288a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5b872f-9744-43a4-94bc-1f6c488c692d", "tag": "f9ed6cf0-0f77-4260-91c6-8234ef158793"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:42.537420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-06e27a14-6e36-44f6-8f38-a4cff67394d0 req-42b38d8b-41c8-4be6-a6bc-395897288a0c service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:42.537931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-06e27a14-6e36-44f6-8f38-a4cff67394d0 req-42b38d8b-41c8-4be6-a6bc-395897288a0c service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:42.538347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-06e27a14-6e36-44f6-8f38-a4cff67394d0 req-42b38d8b-41c8-4be6-a6bc-395897288a0c service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:42.549852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-06e27a14-6e36-44f6-8f38-a4cff67394d0 req-42b38d8b-41c8-4be6-a6bc-395897288a0c service nova] Creating event network-changed:f9ed6cf0-0f77-4260-91c6-8234ef158793 for instance fa5b872f-9744-43a4-94bc-1f6c488c692d on hv-cinder-81966 Aug 30 02:02:42.554716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-06e27a14-6e36-44f6-8f38-a4cff67394d0 req-42b38d8b-41c8-4be6-a6bc-395897288a0c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032934 Aug 30 02:02:42.555314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 47/84] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:02:43.099436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:43.101716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.114725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.115847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.121894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.122831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.125167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.132656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.318581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=32 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:43.324331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:43.325562 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.349359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.349779 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.350207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.351627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.352553 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.353617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.359626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.392663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-11519ea3-9dd9-4f1a-90b0-5b66a9d39745 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.296775 Aug 30 02:02:43.394943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 38/85] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:43 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:43.408385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:43.409018 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.425481 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.428606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.429410 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.434003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.436621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.437261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.743562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.762804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d68c95b5-4e6f-490d-9a16-3e26035762c0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.366410 Aug 30 02:02:43.765151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 39/86] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:43 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:43.776523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:43.778271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:43.788356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.804135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.806166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-50ad8194-68ef-4639-97d9-5835a7d3576d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.487079 Aug 30 02:02:43.806339 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.811860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.812210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 48/87] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:43 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:43.812301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:43.812301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:43.812301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:43.974409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:43.998056 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-14ccd17f-6a6f-494d-867e-8efa9d26f0e0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.231491 Aug 30 02:02:44.003315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 40/88] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:43 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:44.166873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-54cef112-4302-4752-8997-5a5c120169b8 req-42bf066d-e82e-4855-a110-fbe7aa0d7ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0990f725-df36-4f5e-902f-80f670f7e865", "name": "network-vif-plugged", "status": "completed", "tag": "3028796a-2cf7-481a-af93-2e8ba3d0be57"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:44.180409 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-54cef112-4302-4752-8997-5a5c120169b8 req-42bf066d-e82e-4855-a110-fbe7aa0d7ca6 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.183851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-54cef112-4302-4752-8997-5a5c120169b8 req-42bf066d-e82e-4855-a110-fbe7aa0d7ca6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.183851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-54cef112-4302-4752-8997-5a5c120169b8 req-42bf066d-e82e-4855-a110-fbe7aa0d7ca6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.200011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-54cef112-4302-4752-8997-5a5c120169b8 req-42bf066d-e82e-4855-a110-fbe7aa0d7ca6 service nova] Creating event network-vif-plugged:3028796a-2cf7-481a-af93-2e8ba3d0be57 for instance 0990f725-df36-4f5e-902f-80f670f7e865 on hv-cinder-81966 Aug 30 02:02:44.210110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-54cef112-4302-4752-8997-5a5c120169b8 req-42bf066d-e82e-4855-a110-fbe7aa0d7ca6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248291 Aug 30 02:02:44.210909 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 49/89] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:02:44.414029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:44.418383 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:44.418383 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=4 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:44.425535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.426091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.426532 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.427376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.427806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.431779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.596702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:44.605709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a30778ba-5a9d-4eb0-9d08-ab01e1421030 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.194646 Aug 30 02:02:44.606563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 41/90] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:44 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:44.786346 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:44.787506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:44.796427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.796925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.797362 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.798492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.799848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.799848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.849222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:44.849222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:44.850548 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.851038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.851664 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.852369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:44.852817 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:44.853230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:44.980589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:44.998159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-358baa10-1ef5-4b93-9c2c-9caa388e1b4d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.211235 Aug 30 02:02:45.019993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 50/91] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:44 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:45.044746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:45.051775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:45.066150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:45.075515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.076015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.078053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-eb6ce13c-407e-4716-8530-45032405b25c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.246937 Aug 30 02:02:45.079349 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 42/92] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:44 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:45.081953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.081953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.084896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.085357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.305778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:45.319727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dd11a261-8396-4f96-9003-7996da07a1af tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.294237 Aug 30 02:02:45.321211 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 51/93] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:45 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:45.629847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:45.630462 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:45.637593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.638495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.639096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.640122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:45.641086 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:45.641741 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:45.847125 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:45.857526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e6ce962a-95c2-485d-b414-ad2eb8cce51d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.232429 Aug 30 02:02:45.871919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 43/94] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:45 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:46.023310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:46.024016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:46.030605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.031089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.031523 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.032230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.032724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.033090 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.103160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:46.104011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:46.115298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.120814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.120814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.120814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.120814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.121627 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.143644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:46.238966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:46.247183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c609fe22-e1c9-4949-89ec-1f3ece21e104 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.227627 Aug 30 02:02:46.257595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 52/95] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:46 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:46.265387 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a817aa2c-97a9-4aa6-bb24-95caeb130e67", "name": "network-vif-plugged", "status": "completed", "tag": "61565fda-094d-4fe4-931b-8cf82b3d145d"}, {"server_uuid": "5cecad39-31d7-4dc6-a7b7-9c759be0732c", "name": "network-vif-plugged", "status": "completed", "tag": "4fe22a1d-4332-4831-ab82-7f45c452f699"}, {"server_uuid": "0bf23d31-4c2f-4ae6-98c5-bc5ad966309b", "name": "network-vif-plugged", "status": "completed", "tag": "0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:46.278520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.278996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.279426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.298003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Creating event network-vif-plugged:61565fda-094d-4fe4-931b-8cf82b3d145d for instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 on hv-cinder-81966 Aug 30 02:02:46.298548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Creating event network-vif-plugged:4fe22a1d-4332-4831-ab82-7f45c452f699 for instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c on hv-cinder-81966 Aug 30 02:02:46.306350 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] Creating event network-vif-plugged:0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55 for instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b on hv-cinder-81966 Aug 30 02:02:46.307097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-be70197b-06c4-42f1-aa49-ea9bebe5bd44 req-610eaaac-4c01-460e-97b7-4d324d43646e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048105 Aug 30 02:02:46.307888 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 53/96] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:46.326550 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:46.335390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2943141c-bf35-42c1-9836-3f103dc5ee54 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.236045 Aug 30 02:02:46.340893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 44/97] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:46 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:46.346940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:46.350261 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:46.355493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.355907 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.356337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.357219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.357719 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.358255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.525391 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:46.534886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-10388f97-ce26-4868-a487-1be1367cc6dd tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.195524 Aug 30 02:02:46.535551 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 54/98] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:46 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:46.950460 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:46.950460 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:46.950460 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.950460 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.951008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:46.951008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:46.951008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:46.951008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.016484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:47.024068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e35d2926-0b1d-43f7-a93f-95ba03d08bbd tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.148503 Aug 30 02:02:47.033111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 45/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:46 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:47.268252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:47.268853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:47.274786 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.275262 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.275689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.276373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.277035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.277647 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.357681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:47.358347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:47.364584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.365070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.365520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.366213 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.366662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.367079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.412922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:47.422335 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-572d84d2-694a-4e96-be7b-9c631c9f23eb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.157953 Aug 30 02:02:47.422959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 55/100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:47 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:47.502146 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:47.509676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-efcdbc7a-deeb-4b87-887d-07810500d20f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.156552 Aug 30 02:02:47.510230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 46/101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:47 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:47.555824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:47.556435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:47.562604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.563099 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.563882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.564508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:47.564999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:47.565451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:47.569807 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:47.733989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:47.741706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d3a99e71-becf-403d-bbdd-9b80474a8c60 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.189602 Aug 30 02:02:47.742281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 56/102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:47 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:48.047122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:48.049000 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:48.055377 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.055867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.056305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.057010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.057488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.058515 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.281419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:48.288834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9548da18-dae7-454f-be3b-23e7279f31a5 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1315 microversion: 2.1 time: 0.246867 Aug 30 02:02:48.289396 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 47/103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:48 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:48.328892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-9c2e3d1c-a5ef-498d-b012-b15389562e8e req-7b4c95cc-8419-464f-86ca-cb0f6786c8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5b872f-9744-43a4-94bc-1f6c488c692d", "name": "network-vif-plugged", "status": "completed", "tag": "f9ed6cf0-0f77-4260-91c6-8234ef158793"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:48.334399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-9c2e3d1c-a5ef-498d-b012-b15389562e8e req-7b4c95cc-8419-464f-86ca-cb0f6786c8d1 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.334868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-9c2e3d1c-a5ef-498d-b012-b15389562e8e req-7b4c95cc-8419-464f-86ca-cb0f6786c8d1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.335473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-9c2e3d1c-a5ef-498d-b012-b15389562e8e req-7b4c95cc-8419-464f-86ca-cb0f6786c8d1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.354059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-9c2e3d1c-a5ef-498d-b012-b15389562e8e req-7b4c95cc-8419-464f-86ca-cb0f6786c8d1 service nova] Creating event network-vif-plugged:f9ed6cf0-0f77-4260-91c6-8234ef158793 for instance fa5b872f-9744-43a4-94bc-1f6c488c692d on hv-cinder-81966 Aug 30 02:02:48.370174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-9c2e3d1c-a5ef-498d-b012-b15389562e8e req-7b4c95cc-8419-464f-86ca-cb0f6786c8d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040222 Aug 30 02:02:48.370174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 57/104] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:02:48.444282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:48.445624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:48.452105 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.452600 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.453250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.454166 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.454618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.455069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.532314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:48.533301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:48.540378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.541043 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.567324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.567324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.567324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.567324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.604144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:48.613979 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3c46536c-e380-4e9e-9158-71d4fa973389 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.173842 Aug 30 02:02:48.628841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 48/105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:48 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:48.740536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:48.749377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-416eb44e-9349-4b62-bf21-a0273cada75b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.222065 Aug 30 02:02:48.749974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 58/106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:48 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:48.768221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:48.768846 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:48.779573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.780069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.780842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.781842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:48.782626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:48.783207 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:48.926395 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:48.934790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7fe1f8e9-517b-4698-b5e4-425346b5c911 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.172292 Aug 30 02:02:48.935455 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 49/107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:48 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:49.311462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:49.312068 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:49.317940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.318419 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.318846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.319518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.319965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.320379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.451509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:49.460182 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-96db9aa3-28f0-44be-ab06-9556e7457108 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1501 microversion: 2.1 time: 0.153068 Aug 30 02:02:49.460817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 59/108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:49 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:49.635558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:49.636454 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:49.642527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.643085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.643863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.644650 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.645174 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.645717 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.782123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:49.782817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:49.790003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.790633 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.791063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.791775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.793005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.793764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.936167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:49.944027 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9853d324-e37b-4b0d-bd24-99beb4dd1942 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1321 microversion: 2.1 time: 0.168984 Aug 30 02:02:49.944699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 60/109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:49 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:49.962658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:49.963189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:49.969513 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.970003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.970447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:49.971149 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:49.971618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:49.972019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:50.000800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:50.009077 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ea19f3b8-6dfb-4bec-92fc-0e76bae7acb7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.377346 Aug 30 02:02:50.009746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 50/110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:49 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:50.129088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:50.136843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2c46991b-90b9-4dce-80f9-20a13fc4e7ab tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1363 microversion: 2.1 time: 0.178035 Aug 30 02:02:50.137444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 61/111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:49 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:50.968872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:50.968872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:50.975014 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:50.975495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:50.975934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:50.976893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:50.977095 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:50.977633 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.032043 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:51.035583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.046154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.047144 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.047740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.049721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.053300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.053996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.217062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:51.226216 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2a16ce9b-4d62-425e-b2e9-69bfed07af00 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1515 microversion: 2.1 time: 0.263205 Aug 30 02:02:51.227110 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 51/112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:50 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1515 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:51.233889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:51.234745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.241442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.242452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.243080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.243996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.244599 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.245616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.268236 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:51.279675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-64f47d21-b347-4b15-9c13-2aa1f4c64b1d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.252102 Aug 30 02:02:51.280381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 62/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:51 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:51.285886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:51.288317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.295334 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.295936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.296631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.297390 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.297930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.298416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.361515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'flavor' on Instance uuid 5cecad39-31d7-4dc6-a7b7-9c759be0732c {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:02:51.390066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:51.398581 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6b3ceda1-ec3b-4f16-9ba9-1043d282d6ed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1550 microversion: 2.1 time: 0.169502 Aug 30 02:02:51.419250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 52/114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:51 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:51.424770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:51.425378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.436388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.436985 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.437663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.438834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.439791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.440368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.561314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3ba0b312-6b5b-403a-a165-68ab36dcf8da tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140530 Aug 30 02:02:51.562001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 53/115] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:02:51 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:51.840735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b72f540f-ff8d-43dc-b38a-94ca32ec8164 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c/action" status: 200 len: 32 microversion: 2.1 time: 0.558352 Aug 30 02:02:51.847490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 63/116] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:02:51 2022] POST /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c/action => generated 32 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:02:51.859438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:51.860422 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:51.868737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.869227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.870538 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:51.873984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:51.883798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:51.883798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.141707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "695d1bf1-d1cc-4795-9be2-6e65320da139"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:52.152841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:52.178221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:52.187550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:52.187550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.187550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:52.187550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:52.188209 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.228561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:52.239567 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-30bf5a77-4f3b-4035-a8b7-d00a19aa296a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.384085 Aug 30 02:02:52.253070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 54/117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:51 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:52.305699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:52.306330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:52.312337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:52.312811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:52.313237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.313992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:52.314434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:52.314845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:52.635822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:52.643587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f932997e-4ef4-49af-b268-f350ddc820f2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.341744 Aug 30 02:02:52.644161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 55/118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:52 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:53.262446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:53.262446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:53.268156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.268652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.277993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.278755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.279373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.279809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.475242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:53.484785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5db0cab7-cc4a-4b85-a343-7d24e4145ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.228853 Aug 30 02:02:53.485470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 56/119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:53 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:53.489983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-dfa689bb-c82e-4bd4-89b0-84133d3965ef req-61ec4257-6b69-455c-85bf-6451698015ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf23d31-4c2f-4ae6-98c5-bc5ad966309b", "tag": "0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:53.499960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-dfa689bb-c82e-4bd4-89b0-84133d3965ef req-61ec4257-6b69-455c-85bf-6451698015ef service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.500448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-dfa689bb-c82e-4bd4-89b0-84133d3965ef req-61ec4257-6b69-455c-85bf-6451698015ef service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.518766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-dfa689bb-c82e-4bd4-89b0-84133d3965ef req-61ec4257-6b69-455c-85bf-6451698015ef service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.518766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-dfa689bb-c82e-4bd4-89b0-84133d3965ef req-61ec4257-6b69-455c-85bf-6451698015ef service nova] Creating event network-changed:0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55 for instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b on hv-cinder-81966 Aug 30 02:02:53.518766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-dfa689bb-c82e-4bd4-89b0-84133d3965ef req-61ec4257-6b69-455c-85bf-6451698015ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030626 Aug 30 02:02:53.518766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 57/120] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:53.665304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:53.666011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:53.672119 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.672593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.673017 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.673715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:53.674161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:53.674577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:53.812894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:53.821067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fe48c97d-17e3-4a99-a085-350187dae5f6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.159793 Aug 30 02:02:53.837360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 58/121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:53 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:54.508613 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:54.510239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:54.517788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.518425 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.518955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:54.519746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.520293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.520944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:54.764080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:54.803026 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c7aec7c7-3462-4c7b-90e3-fdbd33067f1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.300148 Aug 30 02:02:54.811236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 59/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:54 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:54.847449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:54.848343 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:54.856040 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.856765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.857390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:54.867130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:54.867130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:54.867130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:55.284642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:55.303131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8db41e4f-68c6-4799-bca9-ab938e4cd1a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1365 microversion: 2.1 time: 0.461341 Aug 30 02:02:55.319269 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 60/123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:54 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:55.810619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-83d326c5-be55-4116-a7ee-cf4f4da4947a tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "POST /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.676733 Aug 30 02:02:55.811257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 64/124] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:02:52 2022] POST /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865/os-volume_attachments => generated 194 bytes in 3678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:55.823987 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:55.824595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:55.834436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:55.835002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:55.835800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:55.836799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:55.837832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:55.839037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.119327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:56.127437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cff094fe-ccc0-42ba-9928-a4411a2f6585 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.307293 Aug 30 02:02:56.128336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 61/125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:55 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:56.328765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:56.329472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:56.337488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:56.337977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:56.339354 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.342995 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:56.343680 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:56.344515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.523907 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:56.534249 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b96a5a15-45b5-4125-a1fe-156ab8e753a4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1556 microversion: 2.1 time: 0.210157 Aug 30 02:02:56.534915 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 65/126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:56 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:56.560504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:56.560999 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:56.567522 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:56.568037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:56.568447 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.569172 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:56.569649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:56.570069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:56.574811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:02:56.666351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-97574390-9141-4ef9-b893-4713fe5c26d2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110147 Aug 30 02:02:56.666351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 62/127] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:02:56 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:57.155634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:57.156527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:57.164104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:57.166623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:57.167393 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:57.168336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:57.169002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:57.169855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:57.364085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:57.375068 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-77feb1d1-d960-44d1-85a4-024321807092 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.228997 Aug 30 02:02:57.376062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 66/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:57 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:02:58.200002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-06e56b58-7f39-4b04-876e-be293989fd18 req-760f1140-c2ee-49e4-8846-649f9def349d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5b872f-9744-43a4-94bc-1f6c488c692d", "tag": "f9ed6cf0-0f77-4260-91c6-8234ef158793"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:02:58.209270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-06e56b58-7f39-4b04-876e-be293989fd18 req-760f1140-c2ee-49e4-8846-649f9def349d service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.214359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-06e56b58-7f39-4b04-876e-be293989fd18 req-760f1140-c2ee-49e4-8846-649f9def349d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.214359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-06e56b58-7f39-4b04-876e-be293989fd18 req-760f1140-c2ee-49e4-8846-649f9def349d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.222014 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-06e56b58-7f39-4b04-876e-be293989fd18 req-760f1140-c2ee-49e4-8846-649f9def349d service nova] Creating event network-changed:f9ed6cf0-0f77-4260-91c6-8234ef158793 for instance fa5b872f-9744-43a4-94bc-1f6c488c692d on hv-cinder-81966 Aug 30 02:02:58.227234 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-06e56b58-7f39-4b04-876e-be293989fd18 req-760f1140-c2ee-49e4-8846-649f9def349d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Aug 30 02:02:58.231224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 63/129] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:02:58.398876 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:58.400340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:58.407617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.408461 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.409130 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.410085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:58.410720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:58.411401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:58.586337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:58.604736 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9466287b-fcf6-4f10-bfff-17c38ecad0bd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.209961 Aug 30 02:02:58.605340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 67/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:58 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:02:59.632190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:02:59.632973 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:02:59.639618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:59.640074 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:59.640498 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:59.641501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:02:59.642098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:02:59.642669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:02:59.815514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:02:59.824310 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1e4b0629-ca13-42b7-8da6-2ac1daac345c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.197187 Aug 30 02:02:59.824923 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 64/131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:02:59 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:00.845985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:00.846584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:00.853316 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:00.854342 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:00.854843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:00.855687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:00.856181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:00.856566 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:00.994951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:01.002669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0456c0b3-aefc-4930-9546-be090f640cca tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.160970 Aug 30 02:03:01.003322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 68/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:00 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:02.024550 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:02.026423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:02.033441 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.034139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.034748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.036111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:02.036910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:02.037799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:02.189041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:02.196890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-191aa2bc-934f-4d3a-b93b-3781a51b976c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.176547 Aug 30 02:03:02.197605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 65/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:02 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:03.219126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:03.219877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:03.226297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.226871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.227498 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.228375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:03.229689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:03.230116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:03.363714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:03.372032 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ad668cab-75f2-4198-90b4-13849098189c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.157064 Aug 30 02:03:03.372607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 69/134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:03 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:04.394116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:04.395180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:04.402271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:04.403016 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:04.403465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:04.404305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:04.404865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:04.418261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:04.583952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:04.593504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1b4c99cf-8955-446d-a09f-67fd83e37a46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.203678 Aug 30 02:03:04.594287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 66/135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:04 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:05.615911 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:05.616504 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:05.619593 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=81 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:05.624309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:05.624786 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:05.625216 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:05.632506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:05.632506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:05.632506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:05.632506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:05.792945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:05.802770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3355deb1-8ecd-4be0-a6be-1154d4a2f0b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.190620 Aug 30 02:03:05.804438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 70/136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:05 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:06.824885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:06.825650 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:06.831572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:06.832052 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:06.832480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:06.833166 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:06.833680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:06.834097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:07.029419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:07.039692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-60a102b0-b8c2-4403-8cf5-83200971693d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.219105 Aug 30 02:03:07.041408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 67/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:06 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:07.116198 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:07.116774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:07.126112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:07.126599 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:07.127031 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:07.127729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:07.128186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:07.128658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:07.157985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:03:07.600261 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1f523270-e07f-42d0-992b-e29e5992914d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 204 len: 0 microversion: 2.1 time: 0.488087 Aug 30 02:03:07.601136 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 71/138] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:03:07 2022] DELETE /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:03:07.610148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:07.610758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:07.616941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:07.617431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:07.617887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:07.618578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:07.619667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:07.620105 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:07.754197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:07.764377 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b927d70d-ff94-48e1-bdbe-f1bfff5f343d tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1553 microversion: 2.1 time: 0.158150 Aug 30 02:03:07.766650 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 68/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:07 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:08.062957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:08.063674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:08.069910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.070384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.070818 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.071503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.072663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.072989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.262093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:08.270693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2daa8440-6442-4f3b-ac5c-15a5b4f85e1d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.211902 Aug 30 02:03:08.271270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 72/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:08 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:08.786444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:08.787080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:08.793751 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.794241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.794672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.795369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:08.795819 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:08.796286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:08.959621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:08.973026 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c4adb7cc-cfcd-4ba1-831c-3ceb8ceff072 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1553 microversion: 2.1 time: 0.190693 Aug 30 02:03:08.973811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 69/141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:08 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1553 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:09.293326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:09.296137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:09.300581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:09.301061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:09.301558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:09.302242 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:09.302688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:09.303101 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:09.441539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:09.450317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6d8c17c1-27a7-42f0-abbb-bce636cdca2d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.162035 Aug 30 02:03:09.450904 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 73/142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:09 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:09.995828 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:09.997086 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.003682 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.003787 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.004312 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.005020 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.005489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.005915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.343433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:10.352745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d3850dfc-db42-434c-857e-e9e3f060f9a7 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1553 microversion: 2.1 time: 0.360969 Aug 30 02:03:10.353429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:09 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:10.473129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:10.473868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:10.480844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.481648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.482179 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.483007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.483542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.484033 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.666234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:10.674814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-59ac21f2-921c-40a6-831f-638a12d57288 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.206258 Aug 30 02:03:10.675464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 74/144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:10 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:10.887309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-f7ac07fc-a6ef-43e6-b250-e1c3e1c84e62 req-e8b0b821-80e6-41f1-90da-6b92933ec42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0990f725-df36-4f5e-902f-80f670f7e865", "name": "network-vif-deleted", "tag": "3028796a-2cf7-481a-af93-2e8ba3d0be57"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:10.897886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-f7ac07fc-a6ef-43e6-b250-e1c3e1c84e62 req-e8b0b821-80e6-41f1-90da-6b92933ec42a service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:10.898606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-f7ac07fc-a6ef-43e6-b250-e1c3e1c84e62 req-e8b0b821-80e6-41f1-90da-6b92933ec42a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:10.899432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-f7ac07fc-a6ef-43e6-b250-e1c3e1c84e62 req-e8b0b821-80e6-41f1-90da-6b92933ec42a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:10.919532 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-f7ac07fc-a6ef-43e6-b250-e1c3e1c84e62 req-e8b0b821-80e6-41f1-90da-6b92933ec42a service nova] Creating event network-vif-deleted:3028796a-2cf7-481a-af93-2e8ba3d0be57 for instance 0990f725-df36-4f5e-902f-80f670f7e865 on hv-cinder-81966 Aug 30 02:03:10.922621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-f7ac07fc-a6ef-43e6-b250-e1c3e1c84e62 req-e8b0b821-80e6-41f1-90da-6b92933ec42a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039757 Aug 30 02:03:10.923916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 71/145] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:11.373742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:11.374469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:11.381141 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.381636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.382510 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.382801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.383257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.383679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.446579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:11.455700 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-047a1f87-63cb-4ff9-93d8-8ea1829f48ad tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1346 microversion: 2.1 time: 0.086068 Aug 30 02:03:11.456271 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 75/146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:11 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:11.698244 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:11.702329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:11.705776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.706263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.706701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.707403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:11.707854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:11.708475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:11.890998 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:11.899980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4f5f6a16-630c-4055-9d2c-d5eb93395009 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.205935 Aug 30 02:03:11.900728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 72/147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:11 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:12.476303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:12.477205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:12.485537 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.486896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.487337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.488048 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.489119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.489727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.529419 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.530048 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.530539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.531054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lazy-loading 'fault' on Instance uuid 0990f725-df36-4f5e-902f-80f670f7e865 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:12.581546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f9cfa0ebb84922a9af96ba030ee57a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf405bc0c4b5454aa2b868e9cb5fc7e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:12.590447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-56ea9f27-8672-4abd-af06-e9eb4343a856 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 200 len: 1351 microversion: 2.1 time: 0.118049 Aug 30 02:03:12.591026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 76/148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:12 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:12.921951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:12.922552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:12.924486 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=83 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:12.929247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.929939 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.930514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:12.931951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:12.932582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:12.933047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.181062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:13.189776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fe9f891e-96a6-4160-a4c9-cd336a88bcc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.271726 Aug 30 02:03:13.192521 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 73/149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:12 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:13.617172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:13.617888 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:13.625322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:13.625825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:13.626255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.626941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:13.627388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:13.627939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.641422 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] HTTP exception thrown: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Request method failure captured: Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 HTTP/1.1 Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-fzb9oB0vlKYKEMg3vFQDRjvFtFrQYI6fAoAOCs0tqKHFbrJ4YMFrrA-VPC8u2uckux4RQGSKVWNzRUBblbTOWRvxKFWmC3H9NWrm0XiipOdN0YIevywlZPTdXIIK-dZ4TPd9sJ9ucrwueUe84Jfj7dhALSkJcJXMTAr_bgwE1pZY Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:03:13.646124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 44f9cfa0ebb84922a9af96ba030ee57a Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.647619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '0990f725-df36-4f5e-902f-80f670f7e865'} Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:13.648462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.649985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.651226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Returning 404 to user: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:13.651226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-52811ccc-817a-4af2-a90f-0393a96f9b8b tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 404 len: 111 microversion: 2.1 time: 0.035463 Aug 30 02:03:13.651226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 77/150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:13 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:03:13.799073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:13.801307 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:13.807286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:13.807678 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:13.808097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.808797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:13.809244 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:13.809706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] HTTP exception thrown: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Request method failure captured: Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865/os-volume_attachments HTTP/1.1 Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-fzb9oB0vlKYKEMg3vFQDRjvFtFrQYI6fAoAOCs0tqKHFbrJ4YMFrrA-VPC8u2uckux4RQGSKVWNzRUBblbTOWRvxKFWmC3H9NWrm0XiipOdN0YIevywlZPTdXIIK-dZ4TPd9sJ9ucrwueUe84Jfj7dhALSkJcJXMTAr_bgwE1pZY Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:03:13.835953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 44f9cfa0ebb84922a9af96ba030ee57a Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.838241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'server_id': '0990f725-df36-4f5e-902f-80f670f7e865'} Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:13.839007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:13.840262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:13.841834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Returning 404 to user: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:13.841834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a997f207-64e5-4039-ac3e-23e53dcb6449 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034718 Aug 30 02:03:13.841834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 74/151] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:03:13 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:03:14.212256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:14.212881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:14.223394 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.225794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.225794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.225794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:14.225794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:14.226296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:14.374701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:14.382600 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9a7cb196-b16e-434d-8191-c2267b8c8180 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.174294 Aug 30 02:03:14.383157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 78/152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:14 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:15.196755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:15.197267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:15.203859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.204340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.204774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.205482 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.205942 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.206363 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.220635 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] HTTP exception thrown: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Request method failure captured: Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 HTTP/1.1 Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-fzb9oB0vlKYKEMg3vFQDRjvFtFrQYI6fAoAOCs0tqKHFbrJ4YMFrrA-VPC8u2uckux4RQGSKVWNzRUBblbTOWRvxKFWmC3H9NWrm0XiipOdN0YIevywlZPTdXIIK-dZ4TPd9sJ9ucrwueUe84Jfj7dhALSkJcJXMTAr_bgwE1pZY Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:03:15.222776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 44f9cfa0ebb84922a9af96ba030ee57a Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.230084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '0990f725-df36-4f5e-902f-80f670f7e865'} Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:15.230798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.231848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.232918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Returning 404 to user: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:15.232918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c129884b-e6b5-46f7-9b1f-4c975de1f1e3 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 404 len: 111 microversion: 2.1 time: 0.031752 Aug 30 02:03:15.232918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 75/153] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:03:15 2022] DELETE /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:03:15.235805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:15.236422 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] [instance: 0990f725-df36-4f5e-902f-80f670f7e865] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:15.243066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.244059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.244503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.245195 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.245675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.246101 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.260025 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] HTTP exception thrown: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Request method failure captured: Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 HTTP/1.1 Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-fzb9oB0vlKYKEMg3vFQDRjvFtFrQYI6fAoAOCs0tqKHFbrJ4YMFrrA-VPC8u2uckux4RQGSKVWNzRUBblbTOWRvxKFWmC3H9NWrm0XiipOdN0YIevywlZPTdXIIK-dZ4TPd9sJ9ucrwueUe84Jfj7dhALSkJcJXMTAr_bgwE1pZY Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:03:15.261590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf405bc0c4b5454aa2b868e9cb5fc7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: bf405bc0c4b5454aa2b868e9cb5fc7e1 Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-DeleteServersTestJSON-882984935 Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 44f9cfa0ebb84922a9af96ba030ee57a Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-DeleteServersTestJSON-882984935-project Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.262740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '0990f725-df36-4f5e-902f-80f670f7e865'} Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:03:15.263401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. Aug 30 02:03:15.264462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:03:15.265614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] Returning 404 to user: Instance 0990f725-df36-4f5e-902f-80f670f7e865 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:03:15.265614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-948becff-78a1-4b22-8de2-66d615604a06 tempest-DeleteServersTestJSON-882984935 tempest-DeleteServersTestJSON-882984935-project] 10.222.0.27 "GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865" status: 404 len: 111 microversion: 2.1 time: 0.031011 Aug 30 02:03:15.265614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 79/154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:15 2022] GET /compute/v2.1/servers/0990f725-df36-4f5e-902f-80f670f7e865 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:03:15.403514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:15.404167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:15.410767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.411261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.411691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.412389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:15.412834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:15.413247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:15.757584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:15.766953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1c08c667-e076-4cb1-8e66-f1e246bd312c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.367625 Aug 30 02:03:15.767811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 76/155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:15 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:16.788440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:16.789122 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:16.796882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:16.797816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:16.798420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:16.799297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:16.800066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:16.800646 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:16.968664 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:16.977243 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a33d5bba-725a-4df3-8bd3-1db28fa810ed tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.192156 Aug 30 02:03:16.977591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 80/156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:16 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:18.046624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:18.046624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:18.046624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.046624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.049263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.049263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:18.049263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:18.049263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:18.156890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:18.396915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fbe6c8ac-9d85-4326-aa9a-b54d8128a9d6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.170468 Aug 30 02:03:18.396915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 77/157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:17 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:19.411912 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:19.412526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:19.419197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.419777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.420173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.420865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:19.421322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:19.421897 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:19.614655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:19.637206 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0c4ce576-f702-4ab1-a43a-162f9832e961 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.229249 Aug 30 02:03:19.644848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 81/158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:19 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:20.666252 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:20.666982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:20.672889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.673380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.673843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.674541 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:20.674995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:20.675411 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:20.871561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:20.874982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3ada8c71-1c44-4bb6-8a83-d814c1d18915 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.212735 Aug 30 02:03:20.886161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 78/159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:20 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:21.908012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:21.908012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:21.909377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.909971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.910466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:21.911234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:21.911825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:21.912313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:22.106546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:22.116044 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e9a734d0-acc8-4a9d-9838-11cc7fbd642a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.221738 Aug 30 02:03:22.116629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 82/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:21 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:23.143231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:23.144100 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:23.150697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.151554 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.152077 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.153009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:23.153572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:23.153998 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:23.314217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:23.324603 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a35ea405-2f5b-4b8a-baff-46df6be582c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.185352 Aug 30 02:03:23.325167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 79/161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:23 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:24.347305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:24.347952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:24.354493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.355009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.355450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.356165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:24.356619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:24.357293 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:24.712614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:24.726327 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b0c742b0-6fa2-4fe2-9a09-a131c5ca72d8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.383064 Aug 30 02:03:24.738103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 83/162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:24 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:25.749149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:25.749774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:25.755772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.756569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.756784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.757480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:25.757938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:25.758369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:25.901636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:25.909319 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-57da2504-a736-4614-ac48-439b0e4f9e4d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.164317 Aug 30 02:03:25.909917 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 80/163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:25 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:26.930801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:26.931814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:26.938941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.939424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.939851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:26.940547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:26.940997 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:26.944745 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:27.136018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:27.143698 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8974b563-9cb3-4239-bf90-7764944be4c4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.217149 Aug 30 02:03:27.144964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 84/164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:26 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:28.167968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:28.172351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:28.175712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.176211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.176640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.188428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:28.188428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:28.188428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:28.318222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:28.320469 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=99 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:28.326920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ef036895-6246-4444-b4ca-779fbe4435a8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.164125 Aug 30 02:03:28.327552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 81/165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:28 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:29.348418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:29.349052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:29.356037 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.356899 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.357341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.358177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:29.358878 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:29.359519 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:29.504034 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:29.512117 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-01e29bcb-20c4-4ef8-9eec-4e3ca720a079 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.167574 Aug 30 02:03:29.512776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 85/166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:29 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:30.535888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:30.536595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:30.543718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.544201 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.544657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.545327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:30.545837 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:30.546227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:30.760954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:30.777794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3a5ed823-7a6a-4826-b717-bcd362e8b78d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.245519 Aug 30 02:03:30.791481 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 82/167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:30 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:31.800074 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:31.800682 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:31.808375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.809066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.809583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.810285 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:31.810926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:31.811352 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:31.815966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:31.952630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:31.960190 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-55979530-9286-466e-ad99-6f3c07398603 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.163920 Aug 30 02:03:31.960758 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 86/168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:31 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:32.982465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:32.983485 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:32.989439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.989946 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.990374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:32.991135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:32.991790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:32.992241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:33.210826 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:33.220844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-98774a5a-c19d-40d8-a6de-cd0eea2350fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.242231 Aug 30 02:03:33.221477 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 83/169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:32 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:34.247774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:34.248488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:34.255692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.256186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.256625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.257325 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:34.257902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:34.258273 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:34.395375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:34.403982 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2e5b46d7-2e24-4179-b98d-01c711d9c480 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.162362 Aug 30 02:03:34.404565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 87/170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:34 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:35.426184 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:35.426792 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:35.433196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.433769 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.434140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.434822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:35.435274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:35.435718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:35.588311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:35.616271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-07827a9a-892f-4189-b03a-e50744455f30 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.177420 Aug 30 02:03:35.616271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 84/171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:35 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:36.624312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:36.624920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:36.632120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.632834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.633919 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.634629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:36.635077 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:36.635499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:36.785329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:36.793129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6ce867d4-0c10-4d2d-abe1-cad8868388e3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.172639 Aug 30 02:03:36.793859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 88/172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:36 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:37.814933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:37.815510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:37.821974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.822458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.822891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.823582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:37.824031 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:37.824450 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:37.962076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:37.971718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5f4b3d13-dde2-4368-b2a5-3dfe33877a5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.160652 Aug 30 02:03:37.972292 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 85/173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:37 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:38.993668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:38.993668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:38.995938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:39.006493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.006493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.006493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.006493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:39.006826 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:39.006826 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:39.134755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:39.142587 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c4403c77-62aa-4303-a569-4ee8429d36fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.154330 Aug 30 02:03:39.143178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 89/174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:38 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:40.164442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:40.165547 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:40.171329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.171806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.172231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.173001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:40.173424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:40.173936 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:40.303209 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:40.311563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d85e1237-165a-4337-8567-4f9a3ef0b27e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.151987 Aug 30 02:03:40.312140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 86/175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:40 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:41.332658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:41.333591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:41.340410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.340886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.341597 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.342279 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:41.342727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:41.343142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:41.477163 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:41.485549 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ee19f508-4175-4d9c-a780-0a7877c312d9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.156998 Aug 30 02:03:41.486162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 90/176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:41 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:42.509888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:42.510553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:42.516546 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.517024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.517503 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.518359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:42.518821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:42.527955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:42.659371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:42.667388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-68f68b52-be3c-4a36-8697-de7bb29011b0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.162002 Aug 30 02:03:42.668222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 87/177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:42 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:43.693737 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:43.694345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:43.704231 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.706955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.706955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.706955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:43.706955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:43.708935 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:43.858509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:43.867199 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bf64c045-a377-421a-9925-fa284e2f67ef tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1521 microversion: 2.1 time: 0.181167 Aug 30 02:03:43.867767 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 91/178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:43 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:44.888636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:44.889841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:44.895699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.896247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.896678 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:44.897356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:44.897830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:44.898392 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.055841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:45.063202 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cfd37771-f3fc-4c6b-9086-0fcc6b9de647 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1501 microversion: 2.1 time: 0.178313 Aug 30 02:03:45.064133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 88/179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:44 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:45.085859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:45.086681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:45.093658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.094136 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.094794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.095641 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:45.098343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:45.098343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:45.389666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:45.397581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8aa3b746-27bf-40d4-9226-1eaae9271580 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1516 microversion: 2.1 time: 0.315753 Aug 30 02:03:45.398153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 92/180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:45 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:51.394876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:03:51.397027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:51.404984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=32 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:03:51.404984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.405533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.405911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:51.406605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.407060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.407537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:51.436423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'flavor' on Instance uuid a817aa2c-97a9-4aa6-bb24-95caeb130e67 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:03:51.944647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-edab1b90-dcd3-44f4-9d6a-526ea8f8351c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/action" status: 200 len: 32 microversion: 2.1 time: 0.548694 Aug 30 02:03:51.944647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 89/181] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:03:51 2022] POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/action => generated 32 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:03:51.953138 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:51.953898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:51.961161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.961785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.962222 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:51.962913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:51.963359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:51.963811 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:52.093566 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:52.101396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5b30eec1-bc06-4a15-b597-0c28cf48bae9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.151973 Aug 30 02:03:52.102056 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 93/182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:51 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:53.123526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:53.124251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:53.130549 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:53.131039 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:53.131475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:53.132230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:53.133344 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:53.134038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:53.266901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:53.275146 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cfec72f3-309c-47fe-aa17-5f797051de27 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.155892 Aug 30 02:03:53.275796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 90/183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:53 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:03:54.295272 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:54.295875 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:54.302269 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:54.302746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:54.321347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:54.321347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:54.321347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:54.321347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:54.440697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:54.448928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-410aced8-863b-4215-af76-36ee518d9bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.157434 Aug 30 02:03:54.449500 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 94/184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:54 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:55.470795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:55.471353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:55.477756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:55.478222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:55.478645 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:55.479362 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:55.479800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:55.480216 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:55.613323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:55.624886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-464988ed-6f75-4db7-9d0f-a1908218ca26 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.158308 Aug 30 02:03:55.637577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 91/185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:55 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:56.648601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:56.649194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:56.656215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.656690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.657123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.657842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:56.658294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:56.659072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:56.791978 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:56.802690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9a246514-ddcf-4ade-850c-6aeea27d528e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.155182 Aug 30 02:03:56.802690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 95/186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:56 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:57.822783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:57.823322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:57.829727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.830197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.830725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:57.831323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:57.831765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:57.832177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:58.035009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:58.051371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e2a973e1-ed41-4f28-89b2-5899703448e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.233286 Aug 30 02:03:58.067889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 92/187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:57 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:03:58.440418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:58.440992 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:58.448045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:58.448525 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:58.448955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:58.449676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:58.450130 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:58.450551 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:58.474245 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-51d0f255-fa12-43a7-be2c-a377f8b781be tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/ips" status: 200 len: 147 microversion: 2.1 time: 0.037698 Aug 30 02:03:58.474800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 96/188] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:03:58 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:03:59.074430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:03:59.075946 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:03:59.088041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:59.088595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:59.089095 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:59.090560 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:03:59.091280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:03:59.091712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:03:59.233434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:03:59.242599 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f9a41d7d-6590-4a1c-91a0-397cfabbc947 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.172017 Aug 30 02:03:59.257666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 93/189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:03:59 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:00.263865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:00.264567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:00.272019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.272509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.273005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.273898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:00.274356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:00.274781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:00.482970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:00.491936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2a6c6b77-dada-44d7-afb7-d6e8df6e77f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.232352 Aug 30 02:04:00.493528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 97/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:00 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:01.513752 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:01.514363 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:01.520516 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.520988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.521417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.522122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:01.523055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:01.523470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:01.527527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:01.676050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:01.685232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-690e6058-686f-4c7f-a81b-cb880ca013fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.175225 Aug 30 02:04:01.686148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 94/191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:01 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:02.074031 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2120a55-d39a-47fc-9275-e1f95576a797"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:02.076555 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:02.083170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.083651 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.084086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.096087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.096087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.096087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.715070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:02.715709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:02.727241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.727731 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.728211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.728950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:02.729409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:02.730365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:02.888700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:02.896979 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-63e70547-f00b-4b21-af1d-2f038e240bcc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.187113 Aug 30 02:04:02.897838 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 95/192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:02 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:03.471656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:03.472077 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:03.478996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.479471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.479896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:03.480567 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.481013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.481426 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:03.504617 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8a91d823-4681-45ef-a819-fb965ac82e52 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/ips" status: 200 len: 151 microversion: 2.1 time: 0.037201 Aug 30 02:04:03.521083 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 96/193] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:04:03 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:03.727180 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-62a973af-f593-4f31-bcd0-4e1e8b35e92a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.657754 Aug 30 02:04:03.728621 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 98/194] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:04:02 2022] POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-volume_attachments => generated 194 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:03.923441 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:03.924235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:03.931291 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.931793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.932225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:03.948039 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:03.959063 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:03.960612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:04.136139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:04.145669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f85158be-cfe4-4d14-9e09-5a371c35ff22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.226516 Aug 30 02:04:04.146298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 97/195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:03 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:05.174966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:05.177351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:05.207429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.208123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.208870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.210283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.210780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.211206 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.415994 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:05.423852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e30d12c7-069d-4aaa-bcc6-bf0a747db36a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.255116 Aug 30 02:04:05.426728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 99/196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:05 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:05.767918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2fed156-5a93-4efa-a114-0bb83bd398f5"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:05.770393 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:05.776597 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.777106 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.777562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.778409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:05.778855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:05.779268 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:05.943352 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1047042697", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:05.998420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] validate_networks() for None {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:04:06.307945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:04:06.308522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:04:06.308819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:04:06.309244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:04:06.309684 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:04:06.318423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:06.319455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:06.319948 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:06.320665 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:06.321114 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:06.321935 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:06.339962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Getting quotas for project d779875224e742f9a3f3bf4bfcf12fbc. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:04:06.344407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Getting quotas for user dbce595e3bec45deb120a3d6fe6d6091 and project d779875224e742f9a3f3bf4bfcf12fbc. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:04:06.355794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:04:06.358392 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:04:06.502567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7c6c57fb-f4a0-4d0d-bf9a-1cd6c56c3b31 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562971 Aug 30 02:04:06.503189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 100/197] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:04:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:04:06.508527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:06.509258 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:06.515782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:06.516254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:06.516681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:06.517372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:06.517870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:06.518273 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:06.685782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:06.696699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d79c722f-0528-4128-855e-26ba9254fea5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.192465 Aug 30 02:04:06.697294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 101/198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:06 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:06.702105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8ec44b64-9c03-4ad4-9471-b604bd7dac94 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:06.702712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8ec44b64-9c03-4ad4-9471-b604bd7dac94 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:06.755967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8ec44b64-9c03-4ad4-9471-b604bd7dac94 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:06.763150 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8ec44b64-9c03-4ad4-9471-b604bd7dac94 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1215 microversion: 2.1 time: 0.064786 Aug 30 02:04:06.763799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 102/199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:06 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:06.980882 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0dd71277-1b3e-4c58-8627-dcf137dbd933 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.216373 Aug 30 02:04:06.981785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 98/200] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:04:05 2022] POST /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 194 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:07.720643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:07.722106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:07.729934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:07.734466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:07.734466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:07.734466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:07.734466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:07.734943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:07.758498 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:07.784990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-876ee941-45f0-422b-bc44-55b0c42305ec tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:07.785633 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-876ee941-45f0-422b-bc44-55b0c42305ec tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:07.855181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-876ee941-45f0-422b-bc44-55b0c42305ec tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:07.869533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-876ee941-45f0-422b-bc44-55b0c42305ec tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1215 microversion: 2.1 time: 0.088700 Aug 30 02:04:07.870397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 99/201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:07 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:07.916666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:07.926100 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e08e5389-5ed6-485e-bde1-1a7e762308ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.211828 Aug 30 02:04:07.926874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 103/202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:07 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:08.890221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:08.890940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:08.899185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.899756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.900278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.900977 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.901510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.901935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.947488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:08.948173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:08.956139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.956600 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.957062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.958150 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:08.958607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:08.964281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:08.968687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:08.977300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ac27f56c-2c2a-43f6-823a-2492eb933621 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1219 microversion: 2.1 time: 0.091109 Aug 30 02:04:08.978000 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 100/203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:08 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:09.109726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:09.118054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6b1ef41b-ed6c-4490-a8a8-d995b3c00e85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.174556 Aug 30 02:04:09.118673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 104/204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:08 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:09.998084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:09.998616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:10.005158 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:10.005688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:10.006147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:10.007211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:10.007674 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:10.008098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:10.078401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:10.089542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-90fe841b-79ba-4cbd-8396-8bb07e7e6dd1 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1219 microversion: 2.1 time: 0.095216 Aug 30 02:04:10.090005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 101/205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:09 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:10.140392 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:10.141003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:10.148573 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:10.149056 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:10.149604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:10.150305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:10.150761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:10.151189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:10.474703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:10.484192 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-11fbd785-f596-4355-9003-521fff416a52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.347615 Aug 30 02:04:10.497713 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 105/206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:10 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:11.111219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:11.112121 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:11.119491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:11.119972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:11.120482 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:11.121261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:11.121746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:11.122214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:11.199230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:11.208406 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-13371ca0-20c2-4791-8633-5b2ee798fc54 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1211 microversion: 2.1 time: 0.101181 Aug 30 02:04:11.208982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 102/207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:11 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:11.507084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:11.507698 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:11.514297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:11.514793 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:11.515237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:11.515936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:11.516398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:11.516824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:11.646939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:11.654603 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-41023e17-84d0-4b95-8f7a-513bb448fa02 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.151849 Aug 30 02:04:11.655161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 106/208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:11 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:12.236756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:12.237364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:12.245416 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:12.246173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:12.246611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:12.247295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:12.247899 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:12.248469 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:12.344340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:12.346967 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-94b80972-2ee9-49a8-9fd4-0cef3782d656 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1211 microversion: 2.1 time: 0.114214 Aug 30 02:04:12.347597 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 103/209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:12 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:12.676006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:12.676552 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:12.683139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:12.683631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:12.684066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:12.684755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:12.685207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:12.685662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:12.880224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:12.880224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ece7e052-e213-4268-b901-32d191e6ee22 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.196791 Aug 30 02:04:12.880224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 107/210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:12 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:13.368588 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:13.369211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:13.376014 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:13.376494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:13.376931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:13.378619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:13.378619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:13.378619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:13.471656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:13.481891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-733524f8-2c61-44b4-85b6-0040b8e9b2a7 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1267 microversion: 2.1 time: 0.116255 Aug 30 02:04:13.481891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 104/211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:13 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:13.906103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:13.906103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:13.906103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:13.910361 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:13.910963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:13.911485 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:13.912326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:13.913119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:13.913678 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:14.089207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:14.097204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3fe9b5e4-aa1a-4ff6-baa6-0a3075ba49a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.201484 Aug 30 02:04:14.097796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 108/212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:13 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:14.500303 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:14.501179 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:14.511273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:14.511273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:14.511273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:14.511273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:14.511680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:14.511680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:14.571685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:14.579047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5a344881-a42f-4fbb-9062-45b26669750d tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1267 microversion: 2.1 time: 0.082780 Aug 30 02:04:14.579607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 105/213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:14 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:15.118141 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:15.118870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:15.125726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:15.126217 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:15.126746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:15.127442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:15.127894 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:15.128319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:15.262458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:15.270300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3d00f3d6-093e-4f6a-bddf-4bd037c105dd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.156093 Aug 30 02:04:15.270863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 109/214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:15 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:15.600733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:15.601901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:15.608278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:15.608767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:15.609861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:15.609963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:15.610391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:15.610901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:15.633560 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-58304242-85e1-4c00-ab65-1aae1745a438 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:15.639991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58304242-85e1-4c00-ab65-1aae1745a438 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:15.640469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58304242-85e1-4c00-ab65-1aae1745a438 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:15.641057 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58304242-85e1-4c00-ab65-1aae1745a438 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:15.680952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:15.688458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-367147ab-f7d8-408a-9949-21014b43e66c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1267 microversion: 2.1 time: 0.092135 Aug 30 02:04:15.689017 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 106/215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:15 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:15.701270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-58304242-85e1-4c00-ab65-1aae1745a438 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Going to try to stop instance {{(pid=121094) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 02:04:16.132873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-58304242-85e1-4c00-ab65-1aae1745a438 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action" status: 202 len: 0 microversion: 2.1 time: 0.503207 Aug 30 02:04:16.135934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 110/216] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:04:15 2022] POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:04:16.142225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:16.142897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:16.150255 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:16.150832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:16.151174 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:16.151893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:16.152330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:16.152913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:16.289782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:16.292210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:16.292874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:16.300004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:16.300557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:16.300980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d9b4f3e3-1596-4e6d-bb71-7675d7a209a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.162631 Aug 30 02:04:16.301096 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:16.301912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 107/217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:16 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:16.302043 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:16.302532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:16.303146 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:16.335781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:16.496421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:16.504157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-23682f85-e06f-42b7-9c57-66b4a49ff60b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.216213 Aug 30 02:04:16.504712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 111/218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:16 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:16.709023 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:16.710212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:16.717360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:16.718322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:16.718758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:16.719453 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:16.719995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:16.720308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:16.787575 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:16.795265 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2124bec2-135e-4659-9182-daba1afead09 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1275 microversion: 2.1 time: 0.090246 Aug 30 02:04:16.795835 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 108/219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:16 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:17.322882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:17.323498 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:17.325614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=8 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:17.331983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.343110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.343731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.346492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.346492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.346492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.525807 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:17.526947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:17.527794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:17.536452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.538613 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-93b72c65-2105-40f0-91b8-47a64b2a5293 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.218425 Aug 30 02:04:17.546289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.547913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.550413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 112/220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:17 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:17.550662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.553825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.554493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.759277 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:17.766902 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5dc13be7-8390-413f-afee-ad5b92ef07ad tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1502 microversion: 2.1 time: 0.244053 Aug 30 02:04:17.773084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 109/221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:17 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:17.788795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afbd8d7f-450e-46b9-b45e-8877b3b1fea9"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:17.791234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:17.797479 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.798011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.798451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.799258 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.799629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.800282 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.817626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:17.818649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:17.825799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.826490 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.826667 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] HTTP exception thrown: Cannot 'attach_volume' instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 while it is in vm_state rescued Aug 30 02:04:17.826991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.828015 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Request method failure captured: Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/os-volume_attachments HTTP/1.1 Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 74 Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-j5eMVFWWxeoVc-5Z-GuOXySHRUTux_Ukrnsj75kKbnJP8Al-Cju828nksPBw5nVT3zt1edet8GIOseWj_iM2trtgt0mC0Zo-bKO9lbTjd6b_jB8uDYJIv7BAeYURGbNtdLfie_tdt4XUtDp41_2FmJvOAbTBOcLjiPOcQLrC0NHM Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:04:17.828372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 5e7584fe83684b01baa31ab67edac026 Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {"volumeAttachment": {"volumeId": "afbd8d7f-450e-46b9-b45e-8877b3b1fea9"}} Aug 30 02:04:17.829623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Cannot 'attach_volume' instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 while it is in vm_state rescued Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'server_id': 'a817aa2c-97a9-4aa6-bb24-95caeb130e67', 'body': {'volumeAttachment': {'volumeId': 'afbd8d7f-450e-46b9-b45e-8877b3b1fea9'}}} Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:04:17.830340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 while it is in vm_state rescued Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:17.831383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:17.832404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:04:17.832404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:04:17.832404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 while it is in vm_state rescued Aug 30 02:04:17.832404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:04:17.832645 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.832721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Returning 409 to user: Cannot 'attach_volume' instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 while it is in vm_state rescued {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:04:17.832791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.832870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7ecac3cf-191b-4f9e-b6f7-d8f7f1bc0b4e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045831 Aug 30 02:04:17.832870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 113/222] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:04:17 2022] POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 02:04:17.839752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:17.840283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:17.848445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.849104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.850413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.851488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:17.851957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:17.852392 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:17.863685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:17.904749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:17.907296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:17.914492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-57fa83cd-20ef-4b5e-8bba-149a58608f90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1273 microversion: 2.1 time: 0.101766 Aug 30 02:04:17.915110 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 110/223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:17 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:18.161643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dd8b59ec-5806-4f20-8ced-9d0d1abfbf34 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/action" status: 202 len: 0 microversion: 2.1 time: 0.325182 Aug 30 02:04:18.163312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 114/224] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:04:17 2022] POST /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:04:18.175164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:18.175908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:18.182342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:18.182740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:18.183199 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:18.184074 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:18.184556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:18.184955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:18.408250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:18.415677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-622c5dad-6da3-49cb-a5d2-b47e85226750 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.244373 Aug 30 02:04:18.416685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 111/225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:18 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:18.567269 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:18.569112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:18.577347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:18.578005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:18.578522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:18.579327 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:18.579902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:18.580391 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:18.744124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:18.753636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5e6c1153-504e-4a40-84c4-074a67db9bac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.193739 Aug 30 02:04:18.754211 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 115/226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:18 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:18.935972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:18.936486 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:18.942927 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:18.944012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:18.944462 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:18.945174 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:18.945651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:18.946820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:19.074043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:19.081734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-94d946f0-5afd-4498-b473-d9f7ab171c67 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.149543 Aug 30 02:04:19.082300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 112/227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:18 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:19.437192 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:19.437834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:19.444594 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:19.445079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:19.445537 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:19.446286 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:19.446785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:19.447203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:19.587127 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:19.596293 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-80dba365-0ed1-49cb-8e08-d425f6123d6e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.162866 Aug 30 02:04:19.596871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 116/228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:19 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:19.775640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:19.776249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:19.783513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:19.783992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:19.784427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:19.785110 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:19.785594 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:19.786013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:20.120435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:20.120435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-885f3973-4930-49c2-8180-53f07a45c3b3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.160036 Aug 30 02:04:20.120435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 113/229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:19 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:20.121158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:20.121158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:20.121158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:20.121158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:20.121497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:20.121497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:20.121497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:20.121497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:20.244180 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:20.251829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4312e956-a3f3-4adf-8df9-b874d7d62ad6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.152737 Aug 30 02:04:20.252383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 117/230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:20 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:20.620764 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:20.621681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:20.627563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:20.628041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:20.628470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:20.629154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:20.629657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:20.630111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:20.914567 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:20.922291 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b4c59276-6bfe-4cf7-a3a3-66bea4d75e94 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.306048 Aug 30 02:04:20.922860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 114/231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:20 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:21.135448 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:21.136167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:21.142826 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.143313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.143740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:21.144526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.144975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.145390 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:21.173155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:21.273552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:21.281734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:21.281734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.281734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.281734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:21.282124 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.283175 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.283619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:21.286310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:21.296670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9d3ea0bd-592e-49cd-a47d-09ff9fee3685 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.166026 Aug 30 02:04:21.297248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 118/232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:21 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:21.557237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:21.564818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f605ae22-13ca-4524-a688-1aebcf83f00a tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.296495 Aug 30 02:04:21.565389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 115/233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:21 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:21.868007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-a703a25b-04cb-4868-a339-23daf79f6661 req-a4394577-56ca-49e4-858c-dbe63a14d677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8d6f86-a21e-472f-ab66-7871f67fa834", "tag": "e07fa31c-504e-4844-bcca-6d42fa7d5b04"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:21.879794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a703a25b-04cb-4868-a339-23daf79f6661 req-a4394577-56ca-49e4-858c-dbe63a14d677 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.881526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a703a25b-04cb-4868-a339-23daf79f6661 req-a4394577-56ca-49e4-858c-dbe63a14d677 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.882028 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a703a25b-04cb-4868-a339-23daf79f6661 req-a4394577-56ca-49e4-858c-dbe63a14d677 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:21.893669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-a703a25b-04cb-4868-a339-23daf79f6661 req-a4394577-56ca-49e4-858c-dbe63a14d677 service nova] Creating event network-changed:e07fa31c-504e-4844-bcca-6d42fa7d5b04 for instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 on hv-cinder-81966 Aug 30 02:04:21.899165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-a703a25b-04cb-4868-a339-23daf79f6661 req-a4394577-56ca-49e4-858c-dbe63a14d677 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035403 Aug 30 02:04:21.899764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 119/234] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:21.944758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:21.945364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:21.952596 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.953169 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.964641 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:21.965565 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:21.970257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:21.970257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:22.111715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:22.120271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e025b2c2-bd6a-473b-a9fc-bd0eb833e265 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.180080 Aug 30 02:04:22.120832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 116/235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:21 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:22.319489 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:22.320208 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:22.327714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:22.332252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:22.332252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:22.332252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:22.332252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:22.332587 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:22.472247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:22.480569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7851ab07-eb09-46da-9c2b-f90fe59b057b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.166032 Aug 30 02:04:22.481142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 120/236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:22 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:22.588567 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:22.589216 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:22.602526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:22.602526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:22.602526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:22.602526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:22.602884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:22.602884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:22.801859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:22.811102 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-165d1f90-378d-418c-a8d1-5e67dda3724c tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.228828 Aug 30 02:04:22.811794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 117/237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:22 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:23.147425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:23.148150 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:23.155496 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:23.156228 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:23.157008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:23.158158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:23.158747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:23.159266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:23.298233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:23.306986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-173ac245-da80-4951-878a-bb46c7bf5068 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.166947 Aug 30 02:04:23.307821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 121/238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:23 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:23.508968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:23.508968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:23.508968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=60 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:23.510219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:23.510710 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:23.511156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:23.511856 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:23.512311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:23.512733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:23.643444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:23.652414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-55f0ba51-4d3e-46a5-9c50-59cf5e7692f8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.154015 Aug 30 02:04:23.653060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 118/239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:23 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:23.832547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:23.833287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:23.841686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:23.842242 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:23.842685 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:23.846867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:23.846867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:23.846867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:23.977577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:23.985049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9c78dd98-35cd-4487-a45d-c763c3df3b74 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.157178 Aug 30 02:04:23.988070 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 122/240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:23 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:24.335262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:24.337337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:24.344175 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:24.344667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:24.345104 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:24.345827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:24.346282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:24.346861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:24.490488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:24.498129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f9057c8f-a0e4-4054-97d5-61244cf42395 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.168030 Aug 30 02:04:24.498695 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 119/241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:24 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:24.674105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:24.674782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:24.680746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:24.681224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:24.681687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:24.682398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:24.682845 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:24.683262 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:24.834297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:24.843436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ed3cc7d2-f05f-44fe-b456-324f0b7d3f0f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.173213 Aug 30 02:04:24.844105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 123/242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:24 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:25.007346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:25.007973 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:25.014203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:25.014681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:25.015106 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:25.015856 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:25.016304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:25.016720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:25.151240 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:25.159176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-caca7614-2b1c-4cba-a0d7-c1937c129a90 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.156004 Aug 30 02:04:25.159862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 120/243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:25 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:25.519383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:25.519998 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:25.526268 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:25.532475 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:25.532475 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:25.532475 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:25.532475 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:25.532960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:25.660112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:25.667766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d29d9a1d-f7bb-4f36-9b4c-f7eea0c34f61 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.152223 Aug 30 02:04:25.668328 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 124/244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:25 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:25.865820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:25.866446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:25.872583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:25.873134 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:25.873692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:25.874481 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:25.875271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:25.875768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:26.004391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:26.014091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3463ad14-7332-4849-b353-027505aa8bed tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.152837 Aug 30 02:04:26.014740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 121/245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:25 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:26.180437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:26.181048 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:26.187657 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:26.188148 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:26.188587 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:26.189294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:26.189831 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:26.190207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:26.319672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:26.327494 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4f45ebbf-d42c-4b11-a0b5-a91bce47f9ae tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.151527 Aug 30 02:04:26.328070 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 125/246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:26 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:26.688834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:26.689364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:26.695971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:26.696452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:26.696886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:26.697596 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:26.698051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:26.698467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:26.835475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:26.843978 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2210e3f6-417e-4dc4-91a5-3886fa1a0c42 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.158981 Aug 30 02:04:26.844553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 122/247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:26 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:27.037466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:27.038259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:27.044859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:27.045419 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:27.046250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:27.047316 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:27.047785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:27.048221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:27.184623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:27.194390 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-769ba3ea-39c2-4a72-a4ba-ed1007b9fc83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.161937 Aug 30 02:04:27.195596 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 126/248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:27 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:27.352607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:27.353219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:27.359690 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:27.360167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:27.360597 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:27.361286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:27.361784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:27.362211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:27.491221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:27.498853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1f50d3c1-8881-4008-ab85-74f2ab3a78c6 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.150195 Aug 30 02:04:27.499417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 123/249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:27 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:27.868850 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:27.869493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:27.876590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:27.877071 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:27.877539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:27.878235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:27.878692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:27.879116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.021880 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:28.029500 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-031fff62-409a-445b-a9e9-a93fdfdda765 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1510 microversion: 2.1 time: 0.164518 Aug 30 02:04:28.030071 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 127/250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:27 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:28.215401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:28.216305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:28.224053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.224369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.224590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.225361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.225839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.226262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.358689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:28.368237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e0a7f8bf-a173-4ad0-9a19-32f9306626bc tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.156615 Aug 30 02:04:28.368840 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 124/251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:28 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:28.520283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:28.521472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:28.528290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.528764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.529218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.529935 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:28.530389 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:28.530813 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:28.660780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:28.669289 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-442c1670-0cfd-4ae6-8869-9757bba112cd tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.153011 Aug 30 02:04:28.669893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 128/252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:28 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:29.050418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:29.055916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:29.057004 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.057524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.057966 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.058663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.059117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.059546 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.225882 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:29.233507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-630cf949-4410-4cf9-a377-a923a14eac08 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1516 microversion: 2.1 time: 0.186949 Aug 30 02:04:29.234110 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 125/253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:29 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:29.389518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:29.390112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:29.397225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.397754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.398187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.398874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.399334 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.399755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.544606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:29.553167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d73b257f-ab03-4482-8c41-06595cfb8105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.167435 Aug 30 02:04:29.553774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 129/254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:29 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:29.689474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:29.690706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:29.697365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.698069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.698502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.699197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:29.699653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:29.700071 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:29.836854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:29.844844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6b02bd8a-fdeb-44bc-9ae1-19bd947288e8 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.159290 Aug 30 02:04:29.845408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 126/255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:29 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:30.574066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:30.574672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:30.580980 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.581473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.581914 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.582601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.583056 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.584023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.746181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:30.761703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a35f1220-2f0f-4bc8-9481-49d5c3b8d38b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.184627 Aug 30 02:04:30.761703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 130/256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:30 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:30.866273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:30.867430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:30.873822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.876661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.876661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.876661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:30.876661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:30.876999 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:30.891948 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:31.013048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:31.021108 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9709d8ec-c256-4832-83b4-6b65df608cff tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.159203 Aug 30 02:04:31.031692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 127/257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:30 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:31.477219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b34bae55-d570-455c-a8ee-3a58d496f47e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'create', calling method: .version_select at 0x7f473652fdc0>, body: {"keypair": {"name": "tempest-keypair-1232171576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI485E7koR7ejtSUIwOYtUXcCqE0RDehz5GqH98VhvxomQsTyrEr96Q02OuCW2wdvyvRLwEexzFtvHmZZ3vw+vUg24KRGN6CAGs7oQE2Wfg7ehkm9RSP56XR+Ofcuifm3g=="}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:31.496436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-b34bae55-d570-455c-a8ee-3a58d496f47e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for project e7f4b9bbe0b640688754d04484900cca. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:04:31.501238 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-b34bae55-d570-455c-a8ee-3a58d496f47e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for user 5e7584fe83684b01baa31ab67edac026 and project e7f4b9bbe0b640688754d04484900cca. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:04:31.538115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e580ae16-686a-4071-819a-9d8d1e12afd9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: .version_select at 0x7f4736835af0>, body: {"keypair": {"name": "tempest-keypair-1402803310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqqyo/PXo44ILbRsgFibAD4fEw34TuqoZtgGPg5Bko16Nj6s2x9ymYOYVhICn698eo+KAiu6LZAQGXkCccdMnocfAG8IKmJecx9K94jNffewLnMJrUEej9uq0Ioa3klEg=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:31.552162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-e580ae16-686a-4071-819a-9d8d1e12afd9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:04:31.556467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-e580ae16-686a-4071-819a-9d8d1e12afd9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:04:31.697956 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e580ae16-686a-4071-819a-9d8d1e12afd9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168174 Aug 30 02:04:31.698208 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b34bae55-d570-455c-a8ee-3a58d496f47e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.225909 Aug 30 02:04:31.698808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 128/258] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:04:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:31.698975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 131/259] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:04:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:31.776623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:31.777246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:31.783474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:31.783961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:31.784400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:31.785092 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:31.785579 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:31.786006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:31.979022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:31.987350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-39665a09-2fac-413f-adc5-1be682703eb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.214633 Aug 30 02:04:31.987934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 129/260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:31 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:32.042341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:32.042979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:32.048976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:32.049493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:32.050103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:32.050796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:32.051266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:32.052579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:32.204931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:32.213414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ddd3759d-1e5d-4ab1-8d41-ae74ab4b9db3 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.175066 Aug 30 02:04:32.214010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 132/261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:32 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:33.009890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:33.010501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:33.016956 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:33.017680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:33.018113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:33.018809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:33.019316 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:33.019677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:33.227025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:33.235904 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:33.240715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:33.248772 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:33.249253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:33.250426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:33.251142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:33.252194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:33.252194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:33.256349 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bb7eb41e-7004-4601-93dc-8ed9acf9ad9b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1725 microversion: 2.1 time: 0.251391 Aug 30 02:04:33.257636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 130/262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:33 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:33.449341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:33.457927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b1685658-9243-41af-bb73-7806e3510dc2 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.225662 Aug 30 02:04:33.459642 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 133/263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:33 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:34.292490 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:34.294264 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:34.304196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.304780 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.305815 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.306756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.307289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.308065 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.482089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:34.482814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:34.490203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.490689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.491119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.491863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.492316 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.492847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.639168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:34.647565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-77bceed5-3961-4042-a261-771c36d4f042 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.169909 Aug 30 02:04:34.648154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 134/264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:34 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:34.878790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:34.890813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7da4da70-fa0b-43de-b4f8-602fca93eb7b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1702 microversion: 2.1 time: 0.603582 Aug 30 02:04:34.891703 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 131/265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:34 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1702 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:34.912253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f30ef219-af55-4f70-9daa-24a00cab6775 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:34.918179 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f30ef219-af55-4f70-9daa-24a00cab6775 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:34.918874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f30ef219-af55-4f70-9daa-24a00cab6775 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:34.919728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f30ef219-af55-4f70-9daa-24a00cab6775 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:34.981473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f30ef219-af55-4f70-9daa-24a00cab6775 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Going to try to start instance {{(pid=121094) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 02:04:35.078595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-6e30ac8c-88db-444d-bc49-d5d81c8d6c6e req-5a6b13ae-6185-491b-b383-b02efa69ae10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8d6f86-a21e-472f-ab66-7871f67fa834", "name": "network-vif-plugged", "status": "completed", "tag": "e07fa31c-504e-4844-bcca-6d42fa7d5b04"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:35.088931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-6e30ac8c-88db-444d-bc49-d5d81c8d6c6e req-5a6b13ae-6185-491b-b383-b02efa69ae10 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.089416 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-6e30ac8c-88db-444d-bc49-d5d81c8d6c6e req-5a6b13ae-6185-491b-b383-b02efa69ae10 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.089869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-6e30ac8c-88db-444d-bc49-d5d81c8d6c6e req-5a6b13ae-6185-491b-b383-b02efa69ae10 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.107831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-6e30ac8c-88db-444d-bc49-d5d81c8d6c6e req-5a6b13ae-6185-491b-b383-b02efa69ae10 service nova] Creating event network-vif-plugged:e07fa31c-504e-4844-bcca-6d42fa7d5b04 for instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 on hv-cinder-81966 Aug 30 02:04:35.107831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-6e30ac8c-88db-444d-bc49-d5d81c8d6c6e req-5a6b13ae-6185-491b-b383-b02efa69ae10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031796 Aug 30 02:04:35.107831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 132/266] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:35.172922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:35.326089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f30ef219-af55-4f70-9daa-24a00cab6775 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action" status: 202 len: 0 microversion: 2.1 time: 0.418336 Aug 30 02:04:35.327393 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 135/267] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:04:34 2022] POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:04:35.337182 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:35.338355 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:35.345029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.345618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.346125 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.346896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.347424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.347905 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.597125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1428307351", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d16cb49-ecef-4189-a61f-53bbf0aaef30"}], "security_groups": [{"name": "tempest-securitygroup--1148277334"}], "key_name": "tempest-keypair-1232171576", "user_data": "}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:35.657429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:35.673932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e3c4bfad-8808-4be1-8727-299d75824eba tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1711 microversion: 2.1 time: 0.342410 Aug 30 02:04:35.674816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 133/268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:35 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1711 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:35.680803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:35.680803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:35.691147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.692672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.693479 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.694384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:35.695024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:35.696159 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:35.758635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] validate_networks() for [('1d16cb49-ecef-4189-a61f-53bbf0aaef30', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:04:36.098233 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:36.106719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7d801842-66b6-428f-89ca-2d687dc01f63 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.430837 Aug 30 02:04:36.121447 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 134/269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:35 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:36.210933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-978564354", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316431ff-b22a-409c-830b-a78363ccfbd0"}], "security_groups": [{"name": "tempest-securitygroup--1464271276"}], "key_name": "tempest-keypair-1402803310", "user_data": "}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:36.214284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:04:36.215252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:04:36.216337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:04:36.216826 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:04:36.217314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:04:36.227659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.228245 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.228739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.229740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.230345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.231327 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.251990 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for project e7f4b9bbe0b640688754d04484900cca. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:04:36.257888 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Getting quotas for user 5e7584fe83684b01baa31ab67edac026 and project e7f4b9bbe0b640688754d04484900cca. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:04:36.271216 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:04:36.274229 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:04:36.475587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] validate_networks() for [('316431ff-b22a-409c-830b-a78363ccfbd0', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:04:36.498375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-490a4122-ad4b-4922-a39f-2384607e2ee4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.908552 Aug 30 02:04:36.499379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 136/270] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:04:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:04:36.521499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a7a33e1f-1c1e-4d88-88a5-1d7b1b618b85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:36.521499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a7a33e1f-1c1e-4d88-88a5-1d7b1b618b85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:36.601728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a7a33e1f-1c1e-4d88-88a5-1d7b1b618b85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:36.614760 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a7a33e1f-1c1e-4d88-88a5-1d7b1b618b85 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1246 microversion: 2.1 time: 0.108072 Aug 30 02:04:36.615972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 137/271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:36 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:36.703616 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:36.704359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:36.714489 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.715290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.716159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.717168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:36.717676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:36.718133 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:36.904136 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:36.940116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-de21163c-5f9c-49aa-8146-a7d5a15353db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1711 microversion: 2.1 time: 0.241105 Aug 30 02:04:36.940728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 138/272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:36 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1711 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:37.021650 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:04:37.022068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:04:37.022557 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:04:37.022960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:04:37.023389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:04:37.032371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.032837 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.033265 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.034044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.034491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.034902 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.053061 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:04:37.057165 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:04:37.069010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:04:37.071357 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:04:37.128043 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:37.129263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:37.136997 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.137842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.138437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.139399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.139851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.140269 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.223030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-168e9af4-ed28-4358-8b33-7f5c41602fd4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.017279 Aug 30 02:04:37.224311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 135/273] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:04:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:04:37.236522 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-236224b3-3ce8-4611-855f-38347fb57f1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:37.237128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-236224b3-3ce8-4611-855f-38347fb57f1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:37.311671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-236224b3-3ce8-4611-855f-38347fb57f1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:37.320798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-236224b3-3ce8-4611-855f-38347fb57f1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1241 microversion: 2.1 time: 0.089606 Aug 30 02:04:37.321372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 136/274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:37 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:37.342835 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:37.353537 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-63f224ff-737c-4f09-adb4-55677052d874 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1315 microversion: 2.1 time: 0.230206 Aug 30 02:04:37.372739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 139/275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:37 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:37.637598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1b00425d-64e1-4fb1-9fdd-fc17e157cc05 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:37.638332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1b00425d-64e1-4fb1-9fdd-fc17e157cc05 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:37.699831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1b00425d-64e1-4fb1-9fdd-fc17e157cc05 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:37.707060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1b00425d-64e1-4fb1-9fdd-fc17e157cc05 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1246 microversion: 2.1 time: 0.074934 Aug 30 02:04:37.708027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 137/276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:37 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:37.962050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:37.962661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:37.969495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.969970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.970423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:37.971126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:37.971580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:37.972004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.120160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:38.128691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6a5bdb0e-480b-4282-af37-da6c7f4bb43b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1711 microversion: 2.1 time: 0.170729 Aug 30 02:04:38.129259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 140/277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:37 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:38.348288 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-47408647-fc99-4139-a587-570f146b1d40 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:38.348957 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-47408647-fc99-4139-a587-570f146b1d40 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:38.375869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:38.376463 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:38.383740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:38.384304 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:38.384821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.385739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:38.386411 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:38.387016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.410030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-47408647-fc99-4139-a587-570f146b1d40 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:38.417605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-47408647-fc99-4139-a587-570f146b1d40 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1241 microversion: 2.1 time: 0.072755 Aug 30 02:04:38.421493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 138/278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:38 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:38.557807 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:38.569345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6d04aaa2-90cf-4694-9278-d5762d01afaa tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1464 microversion: 2.1 time: 0.197465 Aug 30 02:04:38.591140 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 141/279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:38 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:38.628632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:38.629217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:38.640098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:38.642585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:38.645401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.646501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:38.647174 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:38.647660 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.681154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Going to try to terminate instance {{(pid=121093) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:04:38.729021 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:38.729661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:38.737447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:38.737961 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:38.738399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.741925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:38.741925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:38.741925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:38.816938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:38.836697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b71139a4-579c-4a25-a610-f689ffa6b653 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1250 microversion: 2.1 time: 0.107604 Aug 30 02:04:38.851021 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 142/280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:38 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1250 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:39.123234 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6ea0ccae-1b01-4b87-9acd-e32ece23dae0 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 204 len: 0 microversion: 2.1 time: 0.498158 Aug 30 02:04:39.124061 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 139/281] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:04:38 2022] DELETE /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:04:39.133045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:39.133801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:39.140305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.141489 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.142357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.143329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.145666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.145666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.152204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:39.153353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:39.160263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.161257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.161737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.168487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.168487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.168487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.338834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:39.347414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-82696cbd-141f-4076-b4c7-8e8121ad7f01 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1715 microversion: 2.1 time: 0.199487 Aug 30 02:04:39.348051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 140/282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:39 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:39.407634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:39.418336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ecd961f6-94cd-4f7c-b147-83c0b76839ef tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1470 microversion: 2.1 time: 0.289799 Aug 30 02:04:39.426274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 143/283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:39 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:39.439221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:39.439913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:39.446812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.447288 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.455208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.455208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.455208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.455208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.543062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:39.551217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-188f8344-8e02-42c1-bacf-9bdd25c46543 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1237 microversion: 2.1 time: 0.115754 Aug 30 02:04:39.566303 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 141/284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:39 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:39.858996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:39.860423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:39.865563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:39.877261 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.878172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.878678 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.879489 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:39.880056 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:39.881152 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:39.978008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:39.984954 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-90f08513-5700-4df3-9a2d-e8b8083e009a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1242 microversion: 2.1 time: 0.129706 Aug 30 02:04:39.985557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 144/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:39 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:40.440187 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:40.440791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:40.447933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.448505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.448933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.450022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.450624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.451164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.584078 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:40.585387 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:40.605925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.606955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.607743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.609351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:40.610081 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:40.610727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:40.649593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:40.658618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ee922cc5-7022-4293-abec-ed78d56cec43 tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1470 microversion: 2.1 time: 0.222229 Aug 30 02:04:40.659803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 142/286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:40 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:40.736630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:40.746860 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b62258d6-8801-489d-bedb-54fde8150299 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1237 microversion: 2.1 time: 0.170233 Aug 30 02:04:40.748088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 145/287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:40 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1237 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:41.010556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:41.011191 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:41.018397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.019101 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.019701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.021187 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.021982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.024393 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.108332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:41.123778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a32c9fbc-0e0f-4613-9be7-c5899759172e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1298 microversion: 2.1 time: 0.113755 Aug 30 02:04:41.123778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 143/288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:41 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:41.521418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-d49dcb14-6712-4ef1-9b89-398bff25c38c req-032c6893-be30-4eb6-808a-15760384db8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8d6f86-a21e-472f-ab66-7871f67fa834", "name": "network-vif-deleted", "tag": "e07fa31c-504e-4844-bcca-6d42fa7d5b04"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:41.532487 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d49dcb14-6712-4ef1-9b89-398bff25c38c req-032c6893-be30-4eb6-808a-15760384db8f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.533280 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d49dcb14-6712-4ef1-9b89-398bff25c38c req-032c6893-be30-4eb6-808a-15760384db8f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.533911 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d49dcb14-6712-4ef1-9b89-398bff25c38c req-032c6893-be30-4eb6-808a-15760384db8f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.546662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-d49dcb14-6712-4ef1-9b89-398bff25c38c req-032c6893-be30-4eb6-808a-15760384db8f service nova] Creating event network-vif-deleted:e07fa31c-504e-4844-bcca-6d42fa7d5b04 for instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 on hv-cinder-81966 Aug 30 02:04:41.552788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-d49dcb14-6712-4ef1-9b89-398bff25c38c req-032c6893-be30-4eb6-808a-15760384db8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Aug 30 02:04:41.557717 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 146/289] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:41.683561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:41.686512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:41.706236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.717493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.717493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.717493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.717493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.717953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.769435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:41.770858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:41.784659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.785153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.785704 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.787396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:41.787396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:41.787745 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:41.844715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:41.852816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ac85c2b7-b263-43c7-8303-69655f47a21b tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1428 microversion: 2.1 time: 0.176409 Aug 30 02:04:41.868097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 144/290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:41 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1428 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:41.902936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:41.916178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-21dce61a-ffa3-4cc4-b4da-cb96e609506a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1293 microversion: 2.1 time: 0.151593 Aug 30 02:04:41.916934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 147/291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:41 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1293 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:42.140069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:42.140676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:42.151868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.152264 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.152692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.153388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.154649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.154649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.282837 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:42.294215 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c05a8f3d-84df-4046-9639-0b58ed4564d1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1298 microversion: 2.1 time: 0.158196 Aug 30 02:04:42.309337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:42 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:42.875775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:42.891681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:42.891681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.891681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.891681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.892291 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.894247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.894715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.941099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:42.943307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.943718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:42.943832 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.944269 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.944723 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lazy-loading 'fault' on Instance uuid 7c8d6f86-a21e-472f-ab66-7871f67fa834 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:04:42.951888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.952840 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.953531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.954514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:42.955194 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:42.955884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:42.996257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbce595e3bec45deb120a3d6fe6d6091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd779875224e742f9a3f3bf4bfcf12fbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:43.014814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-146353de-cf44-4d85-b9a9-bcb7bb68d9da tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 200 len: 1305 microversion: 2.1 time: 0.143194 Aug 30 02:04:43.016062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 148/293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:42 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:43.101427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:43.111464 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c16973c6-e10d-4ecc-b533-855e87f289d8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1299 microversion: 2.1 time: 0.176628 Aug 30 02:04:43.114153 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 146/294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:42 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1299 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:43.316380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:43.317531 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:43.324253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:43.324785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:43.325223 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:43.327636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:43.327636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:43.327636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:43.414806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:43.423403 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d5176bf6-c6cd-4963-b038-72a7bf21c31a tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1304 microversion: 2.1 time: 0.111079 Aug 30 02:04:43.424170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 149/295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:43 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:44.037055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:44.037815 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] [instance: 7c8d6f86-a21e-472f-ab66-7871f67fa834] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:44.048925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.063681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.064419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.065333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.072555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.072555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.086562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] HTTP exception thrown: Instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 could not be found. Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Request method failure captured: Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 HTTP/1.1 Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXASw3aqeJ2XRsQOAoJY_M4XfecbudX6rwSgXTjunU3uvDiLnXh1pGRxkJyFvwjPNL6RxeXLSrwf0viUg62-doxXNgJhD-eeVxWwxXPM3w0p6ZVm_wcAWWkLXZU34t24Eqaff_3OHafKXI1WHZaDGHvifIu2GLZH6K7mr6lmkFUgOww Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: d779875224e742f9a3f3bf4bfcf12fbc Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-VolumesNegativeTest-240126978 Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:04:44.088524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d779875224e742f9a3f3bf4bfcf12fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d779875224e742f9a3f3bf4bfcf12fbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d779875224e742f9a3f3bf4bfcf12fbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d779875224e742f9a3f3bf4bfcf12fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-VolumesNegativeTest-240126978 Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: d779875224e742f9a3f3bf4bfcf12fbc Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-VolumesNegativeTest-240126978 Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-VolumesNegativeTest-240126978-project Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: dbce595e3bec45deb120a3d6fe6d6091 Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-VolumesNegativeTest-240126978-project Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 could not be found. Aug 30 02:04:44.090107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '7c8d6f86-a21e-472f-ab66-7871f67fa834'} Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 could not be found. Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:04:44.090964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 could not be found. Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 could not be found. Aug 30 02:04:44.092499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:04:44.095324 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] Returning 404 to user: Instance 7c8d6f86-a21e-472f-ab66-7871f67fa834 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:04:44.096401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3dc09e0e-7bc6-4383-ad14-fcc0b2fd40be tempest-VolumesNegativeTest-240126978 tempest-VolumesNegativeTest-240126978-project] 10.222.0.27 "GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834" status: 404 len: 111 microversion: 2.1 time: 0.064046 Aug 30 02:04:44.112241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 147/296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:44 2022] GET /compute/v2.1/servers/7c8d6f86-a21e-472f-ab66-7871f67fa834 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:04:44.139451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:44.140258 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:44.149634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.177900 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.178523 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.179456 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.180108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.180561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.448659 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:44.449608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:44.468055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.468897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.469579 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.470501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:44.471401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:44.472078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:44.491816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:44.494107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:44.515934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a9516d95-f721-49f9-bcb6-229184cd0b16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.369177 Aug 30 02:04:44.517418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 150/297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:44 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:44.907439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:44.913361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d147cf8e-5f9a-42e2-b1c0-2ef4c01d21f5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.468976 Aug 30 02:04:44.915547 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 148/298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:44 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:45.541469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:45.542085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:45.549168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:45.552817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:45.553028 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:45.554018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:45.557148 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:45.557678 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:45.750548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:45.759865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aa5e576f-ba43-4d4b-b11a-3d719df55c24 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.222658 Aug 30 02:04:45.760458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 151/299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:45 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:45.937013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:45.938195 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:45.940646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:45.946873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:45.947365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:45.947982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:45.948683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:45.949258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:45.949885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:46.159119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-a1dc66e6-0a44-4ee3-b1d5-c339d1d2a250 req-0db82cd3-7758-43a8-bdac-4b40b2e801fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4", "tag": "8b6c3ad2-e81a-4dbf-bc9b-548cbff19569"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:46.170625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a1dc66e6-0a44-4ee3-b1d5-c339d1d2a250 req-0db82cd3-7758-43a8-bdac-4b40b2e801fc service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:46.171191 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a1dc66e6-0a44-4ee3-b1d5-c339d1d2a250 req-0db82cd3-7758-43a8-bdac-4b40b2e801fc service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:46.171711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a1dc66e6-0a44-4ee3-b1d5-c339d1d2a250 req-0db82cd3-7758-43a8-bdac-4b40b2e801fc service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:46.190560 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-a1dc66e6-0a44-4ee3-b1d5-c339d1d2a250 req-0db82cd3-7758-43a8-bdac-4b40b2e801fc service nova] Creating event network-changed:8b6c3ad2-e81a-4dbf-bc9b-548cbff19569 for instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 on hv-cinder-81966 Aug 30 02:04:46.196625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-a1dc66e6-0a44-4ee3-b1d5-c339d1d2a250 req-0db82cd3-7758-43a8-bdac-4b40b2e801fc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041079 Aug 30 02:04:46.197400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 152/300] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:46.225294 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:46.235480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a340fd6b-c862-4651-82f7-b3bd914b5e46 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.302475 Aug 30 02:04:46.235843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 149/301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:45 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:46.784359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:46.788271 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=12 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:46.794703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:46.795575 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:46.804648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:46.806636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:46.807360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:46.808483 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:46.809203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:46.810627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:47.040492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:47.049501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fad75839-7b9e-492d-b027-6ca7a1cc50b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.266513 Aug 30 02:04:47.050810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 153/302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:46 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:47.256991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:47.257640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:47.259939 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:47.265662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:47.266159 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:47.266598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:47.267301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:47.267759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:47.268185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:47.582642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:47.600242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6dbb1290-58a3-4199-9dbc-3b66105fa676 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.347673 Aug 30 02:04:47.603606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 150/303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:47 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:48.072753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:48.073361 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:48.081058 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:48.081844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:48.082351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:48.083578 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:48.084375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:48.085016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:48.222601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-cd593236-e5e7-4633-947c-adee86c6d894 req-ab0dfd74-d158-4b25-a108-c79d2e3f9663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecaa0bb-82d5-4a54-b0de-3f755d373450", "tag": "0613d132-cca5-44d5-80b4-de90c29f8aa0"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:48.247231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cd593236-e5e7-4633-947c-adee86c6d894 req-ab0dfd74-d158-4b25-a108-c79d2e3f9663 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:48.247708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cd593236-e5e7-4633-947c-adee86c6d894 req-ab0dfd74-d158-4b25-a108-c79d2e3f9663 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:48.248133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cd593236-e5e7-4633-947c-adee86c6d894 req-ab0dfd74-d158-4b25-a108-c79d2e3f9663 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:48.264158 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-cd593236-e5e7-4633-947c-adee86c6d894 req-ab0dfd74-d158-4b25-a108-c79d2e3f9663 service nova] Creating event network-changed:0613d132-cca5-44d5-80b4-de90c29f8aa0 for instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 on hv-cinder-81966 Aug 30 02:04:48.271775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-cd593236-e5e7-4633-947c-adee86c6d894 req-ab0dfd74-d158-4b25-a108-c79d2e3f9663 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058063 Aug 30 02:04:48.275366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 151/304] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:04:48.329549 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:48.338875 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5e3f0e6f-4a0e-48d8-a11b-3c2ee8348288 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.271342 Aug 30 02:04:48.339591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 154/305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:48 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:48.625276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:48.626866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:48.630933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=16 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:48.658279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:48.659079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:48.659679 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:48.660559 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:48.661234 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:48.662140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:48.875822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:48.888039 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f6598ee4-0f82-49b4-b3df-f025479e78ff tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.268262 Aug 30 02:04:48.892689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 152/306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:48 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:49.360283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:49.360895 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:49.369960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:49.370748 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:49.371505 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:49.378266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:49.378266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:49.378266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:49.422378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:04:49.617598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:49.643912 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0de87467-45d5-4c87-9481-62332eed9a9f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.287413 Aug 30 02:04:49.645269 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 155/307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:49 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:49.928836 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:49.930531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:49.947724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:49.955328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:49.956611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:49.958088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:49.958802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:49.959922 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:50.252934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:50.259568 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-31def9b5-4256-4488-8529-d46c23058669 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.335960 Aug 30 02:04:50.260590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 153/308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:49 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:50.668956 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:50.669788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:50.678312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:50.679189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:50.679842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:50.680855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:50.681542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:50.682301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:50.864700 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:50.874505 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-794e0819-0de9-4134-8b2b-cd5b6e0cef9c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.211690 Aug 30 02:04:50.890662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 156/309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:50 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:51.287559 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:51.288289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:51.296561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:51.297282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:51.298381 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:51.299168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:51.299698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:51.300192 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:51.484976 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:51.498792 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f8bdd6e9-27c9-4aa7-8c58-4567158f6cf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.212417 Aug 30 02:04:51.498792 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 154/310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:51 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:51.905177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:51.909156 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:51.918045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:51.918532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:51.919130 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:51.920005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:51.920621 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:51.921198 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:52.156437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:52.173923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-26fb3cbb-9101-4b52-afc1-70fbb4645f8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.278157 Aug 30 02:04:52.175265 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 157/311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:51 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:52.516617 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:52.517212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:52.524999 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:52.525438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:52.525903 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:52.526793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:52.527439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:52.527849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:52.698943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:52.707458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b0d005e3-a052-4722-b6a1-b25f6ebb4998 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.195003 Aug 30 02:04:52.708755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 155/312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:52 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:53.198815 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:53.199431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:53.213858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:53.214496 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:53.215004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:53.215828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:53.216353 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:53.217098 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:53.421021 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:53.430063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0c9a906f-8a49-4cc4-a499-42e0af841f06 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.235410 Aug 30 02:04:53.447318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 158/313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:53 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:53.731187 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:53.733076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:53.742355 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:53.743683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:53.744359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:53.745440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:53.746203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:53.746998 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:53.890808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:53.898655 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ed7ca26f-85be-4aa8-ad92-5cf5220d3eb8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.171466 Aug 30 02:04:53.909670 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 156/314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:53 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:54.451624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:54.452301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:54.460249 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.461022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.461661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.462563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.463013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.463491 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.740877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:54.757820 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1ef8d6c4-b355-416a-a3ec-c834419a768f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.309770 Aug 30 02:04:54.766397 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 159/315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:54 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:54.928262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:54.929748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:54.941211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.941830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.942935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:54.943972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:54.945251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:54.945723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:55.180861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:55.190927 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-291fd4f8-1dcc-4850-891c-745e934a8f31 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.272907 Aug 30 02:04:55.206561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 157/316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:54 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:55.248298 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-4ca8cecc-81f6-4e89-9b7f-7d1973504025 req-c0ad4eb5-dfc2-41ca-a93e-7d3bdc2ddee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4", "name": "network-vif-plugged", "status": "completed", "tag": "8b6c3ad2-e81a-4dbf-bc9b-548cbff19569"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:55.275204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-4ca8cecc-81f6-4e89-9b7f-7d1973504025 req-c0ad4eb5-dfc2-41ca-a93e-7d3bdc2ddee1 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:55.275692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-4ca8cecc-81f6-4e89-9b7f-7d1973504025 req-c0ad4eb5-dfc2-41ca-a93e-7d3bdc2ddee1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:55.276130 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-4ca8cecc-81f6-4e89-9b7f-7d1973504025 req-c0ad4eb5-dfc2-41ca-a93e-7d3bdc2ddee1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:55.305846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-4ca8cecc-81f6-4e89-9b7f-7d1973504025 req-c0ad4eb5-dfc2-41ca-a93e-7d3bdc2ddee1 service nova] Creating event network-vif-plugged:8b6c3ad2-e81a-4dbf-bc9b-548cbff19569 for instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 on hv-cinder-81966 Aug 30 02:04:55.312220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-4ca8cecc-81f6-4e89-9b7f-7d1973504025 req-c0ad4eb5-dfc2-41ca-a93e-7d3bdc2ddee1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067870 Aug 30 02:04:55.317256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 160/317] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:55.779413 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:55.781002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:55.797992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:55.798944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:55.800138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:55.801060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:55.803700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:55.804726 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:56.086785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:56.095827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-57517ae0-3678-49b3-aff2-312835e88636 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.321137 Aug 30 02:04:56.096402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 158/318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:55 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:56.225010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:56.225915 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:56.234395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:56.234872 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:56.235308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:56.236139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:56.236610 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:56.237019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:56.429099 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:56.439767 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-37860afb-ac0a-444d-aaca-0d25967d3036 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.221369 Aug 30 02:04:56.440626 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 161/319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:56 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:57.140036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:57.141353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:57.149597 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.150607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.151278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.152301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.153537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.154194 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.336423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-27b84587-25d2-4ef3-827c-805097413c46 req-17e795c2-d503-4b11-a1c1-ffa9ba9b207f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ecaa0bb-82d5-4a54-b0de-3f755d373450", "name": "network-vif-plugged", "status": "completed", "tag": "0613d132-cca5-44d5-80b4-de90c29f8aa0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:04:57.358458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-27b84587-25d2-4ef3-827c-805097413c46 req-17e795c2-d503-4b11-a1c1-ffa9ba9b207f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.366221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-27b84587-25d2-4ef3-827c-805097413c46 req-17e795c2-d503-4b11-a1c1-ffa9ba9b207f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.367227 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-27b84587-25d2-4ef3-827c-805097413c46 req-17e795c2-d503-4b11-a1c1-ffa9ba9b207f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.384060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-27b84587-25d2-4ef3-827c-805097413c46 req-17e795c2-d503-4b11-a1c1-ffa9ba9b207f service nova] Creating event network-vif-plugged:0613d132-cca5-44d5-80b4-de90c29f8aa0 for instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 on hv-cinder-81966 Aug 30 02:04:57.392102 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-27b84587-25d2-4ef3-827c-805097413c46 req-17e795c2-d503-4b11-a1c1-ffa9ba9b207f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059924 Aug 30 02:04:57.393343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 162/320] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:57.419424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:57.428999 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f1f4fb68-4f0a-479e-8fa0-bbd820f720b0 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1367 microversion: 2.1 time: 0.299613 Aug 30 02:04:57.430082 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 159/321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:57 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:04:57.463104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:57.464226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:57.471181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.471959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.472598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.474153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:57.475210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:57.476067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:57.646094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:57.669294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-62fd0e2a-9593-4436-a769-6fb4ab021cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.211031 Aug 30 02:04:57.670490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 163/322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:57 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:58.450908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:58.451483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:58.458448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.459008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.459445 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.460161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.460662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.461088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.599553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:58.607553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d3ed456e-57a0-4d67-a956-87c6f7ce3a8a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1558 microversion: 2.1 time: 0.160609 Aug 30 02:04:58.608113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 160/323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:58 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:04:58.628498 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:58.629759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:58.636527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.637012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.637450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.638170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.638621 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.639041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.695896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:04:58.700498 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:04:58.724052 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.731365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.739741 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.739741 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:04:58.739741 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:04:58.744915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:04:58.786376 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e05e7e70-ba57-418e-8c3e-97a927eeecb8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161765 Aug 30 02:04:58.786880 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 164/324] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:04:58 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:04:59.054499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:04:59.069251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3200b673-7963-43fe-b0df-6dfacd6b27fe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.378169 Aug 30 02:04:59.083535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 161/325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:04:58 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:00.091080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:00.092668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:00.111547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:00.111547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:00.111547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:00.112671 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:00.114818 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:00.115434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:00.381785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:00.390880 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9b7b1aef-09c9-4f76-a5c8-7c6219e1dcf4 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1372 microversion: 2.1 time: 0.303933 Aug 30 02:05:00.405778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 165/326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:00 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:00.844601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-5781bd49-5c70-4cbc-b02c-13d90225d52e req-5984ea25-2c3c-4e12-8621-6ef4a59fa215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4", "tag": "8b6c3ad2-e81a-4dbf-bc9b-548cbff19569"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:00.869673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-5781bd49-5c70-4cbc-b02c-13d90225d52e req-5984ea25-2c3c-4e12-8621-6ef4a59fa215 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:00.870290 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-5781bd49-5c70-4cbc-b02c-13d90225d52e req-5984ea25-2c3c-4e12-8621-6ef4a59fa215 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:00.870564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-5781bd49-5c70-4cbc-b02c-13d90225d52e req-5984ea25-2c3c-4e12-8621-6ef4a59fa215 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:00.886501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-5781bd49-5c70-4cbc-b02c-13d90225d52e req-5984ea25-2c3c-4e12-8621-6ef4a59fa215 service nova] Creating event network-changed:8b6c3ad2-e81a-4dbf-bc9b-548cbff19569 for instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 on hv-cinder-81966 Aug 30 02:05:00.891785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-5781bd49-5c70-4cbc-b02c-13d90225d52e req-5984ea25-2c3c-4e12-8621-6ef4a59fa215 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051205 Aug 30 02:05:00.903654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 162/327] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:01.414132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:01.415601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:01.429298 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:01.429862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:01.430474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:01.431202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:01.431662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:01.432087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:01.796764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:01.807467 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-69d535bb-b346-4f06-b19e-c5c66d3ab5e7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1567 microversion: 2.1 time: 0.399137 Aug 30 02:05:01.822451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 166/328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:01 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:01.842206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:01.843573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:01.875806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:01.876519 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:01.878682 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:01.882854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:01.884037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:01.890766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:02.022019 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-838ad2be-dc2b-4485-af5e-7c595a2060a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172830 Aug 30 02:05:02.022019 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 163/329] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:05:01 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:03.969739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-e2aca20e-76b5-4272-b74e-f778deab4227 req-5d0f619b-2d22-4047-bff0-e40141ee34f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecaa0bb-82d5-4a54-b0de-3f755d373450", "tag": "0613d132-cca5-44d5-80b4-de90c29f8aa0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:03.981966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-e2aca20e-76b5-4272-b74e-f778deab4227 req-5d0f619b-2d22-4047-bff0-e40141ee34f7 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:03.982736 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-e2aca20e-76b5-4272-b74e-f778deab4227 req-5d0f619b-2d22-4047-bff0-e40141ee34f7 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:03.983383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-e2aca20e-76b5-4272-b74e-f778deab4227 req-5d0f619b-2d22-4047-bff0-e40141ee34f7 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:04.001001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-e2aca20e-76b5-4272-b74e-f778deab4227 req-5d0f619b-2d22-4047-bff0-e40141ee34f7 service nova] Creating event network-changed:0613d132-cca5-44d5-80b4-de90c29f8aa0 for instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 on hv-cinder-81966 Aug 30 02:05:04.007760 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-e2aca20e-76b5-4272-b74e-f778deab4227 req-5d0f619b-2d22-4047-bff0-e40141ee34f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042942 Aug 30 02:05:04.009085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 167/330] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:08.891010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-01696f12-0579-4b29-8669-64bf31c468f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Action: 'create', calling method: .version_select at 0x7f473680d310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-683002779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyS4zQ+8nf1CTeIunwQ10SeQQkXVL9ZDqQZwIxxAzHC8aL1FTcrIn8LVCa+5QjnGP2L5W/T7xYm/aM4ek45MIvacTX07NhzOr3NX0qcdBPQ4XsvMnUGOYt3rs6LPtbjnw=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:08.906830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-01696f12-0579-4b29-8669-64bf31c468f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Getting quotas for project b6200be9acd14756908c3fd33adf1506. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:08.910572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-01696f12-0579-4b29-8669-64bf31c468f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Getting quotas for user 95c7f09cc2ba4dddae564bbe99ea8a7d and project b6200be9acd14756908c3fd33adf1506. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:09.011177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-01696f12-0579-4b29-8669-64bf31c468f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.124749 Aug 30 02:05:09.011991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 164/331] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:05:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:09.116425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-280285149", "imageRef": "e873d1cf-11ef-4a16-8478-eabbed335cb8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-683002779", "networks": [{"uuid": "fb93bb88-cb60-46a7-8b65-48732a562f78"}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:09.170300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] validate_networks() for [('fb93bb88-cb60-46a7-8b65-48732a562f78', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:05:09.561476 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:05:09.561916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:05:09.562383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:05:09.562810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:05:09.563406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:05:09.573230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:09.574728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:09.575319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:09.576221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:09.576842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:09.577568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:09.597628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Getting quotas for project b6200be9acd14756908c3fd33adf1506. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:09.603120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Getting quotas for user 95c7f09cc2ba4dddae564bbe99ea8a7d and project b6200be9acd14756908c3fd33adf1506. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:09.623651 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:05:09.629172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e873d1cf-11ef-4a16-8478-eabbed335cb8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:05:09.682844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-53049396", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "networks": [{"uuid": "2761f1ac-422e-4add-8966-d7328f515b23"}]}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:09.744465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] validate_networks() for [('2761f1ac-422e-4add-8966-d7328f515b23', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:05:09.818081 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c5b1955e-57b4-4518-b722-f305c0f89f07 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706343 Aug 30 02:05:09.818857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 168/332] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:05:09.830917 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8f22eb5d-dff2-4722-af43-7373417ade48 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:09.831881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8f22eb5d-dff2-4722-af43-7373417ade48 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:09.910703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8f22eb5d-dff2-4722-af43-7373417ade48 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:09.921607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8f22eb5d-dff2-4722-af43-7373417ade48 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1257 microversion: 2.1 time: 0.094214 Aug 30 02:05:09.922205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 169/333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:09 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1257 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:10.484681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:05:10.485178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:05:10.485662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:05:10.486099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:05:10.486537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:05:10.496167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:10.496648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:10.497086 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:10.497865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:10.498351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:10.498784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:10.517188 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Getting quotas for project 072e2c259a164ecaa45b5ff18fa3ac66. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:05:10.521227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Getting quotas for user 789377907cfd4f0f9d3123f6418163f7 and project 072e2c259a164ecaa45b5ff18fa3ac66. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:05:10.532685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:05:10.535228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:05:10.704246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0333e70e-744e-4c78-bb2e-40739c945c82 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025421 Aug 30 02:05:10.704685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 165/334] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:05:10.716015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a9e58109-18e8-4959-ac25-eb917153e6b2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:10.717758 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a9e58109-18e8-4959-ac25-eb917153e6b2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:10.772097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a9e58109-18e8-4959-ac25-eb917153e6b2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:10.779564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a9e58109-18e8-4959-ac25-eb917153e6b2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1217 microversion: 2.1 time: 0.067548 Aug 30 02:05:10.780128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 170/335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:10 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:10.943418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-87fdf026-36b3-491c-b898-a0a21ad69602 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:10.944114 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-87fdf026-36b3-491c-b898-a0a21ad69602 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:10.997994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-87fdf026-36b3-491c-b898-a0a21ad69602 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:11.006030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-87fdf026-36b3-491c-b898-a0a21ad69602 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1257 microversion: 2.1 time: 0.066437 Aug 30 02:05:11.006794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 166/336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:10 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:11.800387 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-26be25d2-202d-4003-9f4c-1c3fd721470a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:11.801036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-26be25d2-202d-4003-9f4c-1c3fd721470a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:11.803614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:11.857928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-26be25d2-202d-4003-9f4c-1c3fd721470a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:11.864776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-26be25d2-202d-4003-9f4c-1c3fd721470a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1217 microversion: 2.1 time: 0.068407 Aug 30 02:05:11.865329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 171/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:11 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:12.027545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:12.029278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:12.038320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.038872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.039436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.041111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.041111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.041111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.103854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:12.111350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-16a80024-01cf-4eeb-8d8d-de619815cf17 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1253 microversion: 2.1 time: 0.088261 Aug 30 02:05:12.111925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 167/338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:12 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1253 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:12.898545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:12.898545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:12.898545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.899785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.900221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.900924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:12.901377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:12.901886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:12.966680 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:12.975963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6b4a45d7-c173-46e8-b165-4a09337dcbef tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1221 microversion: 2.1 time: 0.091011 Aug 30 02:05:12.978129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 172/339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:12 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:13.134173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:13.134781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:13.141852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.142332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.142755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.143437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:13.143889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:13.144301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:13.211490 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:13.220239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9f117e75-f220-4a89-9b8d-e5665d7d5b9b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1309 microversion: 2.1 time: 0.090179 Aug 30 02:05:13.220791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 168/340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:13 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:13.996746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:13.997380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:14.004178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:14.004648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:14.005139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:14.005814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:14.006262 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:14.006676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:14.072263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:14.081072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-116027b2-5739-494e-ba62-c700be0ea95a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1269 microversion: 2.1 time: 0.088112 Aug 30 02:05:14.085400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 173/341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:13 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:14.242025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:14.242631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:14.249916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:14.250395 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:14.250821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:14.251514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:14.251981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:14.252408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:14.268037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:14.320256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:14.327876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2581c81a-9d6e-4d39-951a-3eea9ce63fcb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1327 microversion: 2.1 time: 0.089890 Aug 30 02:05:14.328454 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 169/342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:14 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:15.106543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:15.106543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:15.116642 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:15.117752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:15.118655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:15.120121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:15.121334 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:15.122083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:15.207086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:15.216977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c9bc2c28-f308-402d-8c43-e14b59ea59f0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1275 microversion: 2.1 time: 0.117330 Aug 30 02:05:15.232409 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 174/343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:15 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:15.349900 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:15.350869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:15.359760 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:15.360740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:15.361393 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:15.362385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:15.363186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:15.363686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:15.690338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:15.702158 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-51f438ca-b9be-4637-b238-fc74a3ff5add tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.356696 Aug 30 02:05:15.702749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 170/344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:15 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:16.238844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:16.239445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:16.253124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.253650 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.254091 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.254810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.255276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.255704 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.399333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-b2f28dd3-5a8a-48a4-bc13-dc99312fceaf req-915a36e6-03d9-471f-b9a4-d4a3870d452f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:16.419222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-b2f28dd3-5a8a-48a4-bc13-dc99312fceaf req-915a36e6-03d9-471f-b9a4-d4a3870d452f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.429730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-b2f28dd3-5a8a-48a4-bc13-dc99312fceaf req-915a36e6-03d9-471f-b9a4-d4a3870d452f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.429730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-b2f28dd3-5a8a-48a4-bc13-dc99312fceaf req-915a36e6-03d9-471f-b9a4-d4a3870d452f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.436953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:16.438292 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-b2f28dd3-5a8a-48a4-bc13-dc99312fceaf req-915a36e6-03d9-471f-b9a4-d4a3870d452f service nova] Creating event network-changed:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:05:16.444394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-b2f28dd3-5a8a-48a4-bc13-dc99312fceaf req-915a36e6-03d9-471f-b9a4-d4a3870d452f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048793 Aug 30 02:05:16.445163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 171/345] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:16.450762 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-69af7683-7070-4e68-a16c-7c1c2fe5dfb2 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.215616 Aug 30 02:05:16.451352 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 175/346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:16 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:16.724476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:16.725435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:16.733961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.734728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.735333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.736247 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:16.736703 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:16.737127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:16.876337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:16.885227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-82e943f8-39e4-4fce-9f04-5fcb447c31c4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.164974 Aug 30 02:05:16.886518 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 172/347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:16 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:17.476639 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:17.479241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:17.491770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.492692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.493532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.494819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.495316 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.496561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.641107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:17.649374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f4275d18-7e90-4eb0-af55-d8ea07174363 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.180031 Aug 30 02:05:17.649966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 176/348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:17 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:17.908406 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:17.909370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:17.919816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.920430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.920894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:17.921698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:17.922163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:17.922591 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.084487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:18.093048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-88b57c0a-866a-4518-8934-eb574f92b4ad tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.189133 Aug 30 02:05:18.097331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 173/349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:17 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:18.671303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:18.671918 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:18.678725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:18.679255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:18.679693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.680396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:18.680993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:18.681421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:18.816305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:18.819689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:18.824244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-52933593-1f54-45fd-ad29-2b452db8f513 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.156986 Aug 30 02:05:18.824823 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 177/350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:18 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:19.114064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:19.114673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:19.121616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.122094 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.122525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:19.123214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.123665 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.124085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:19.273347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:19.282015 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4dbce5d7-3705-4fa1-9b89-cc3f267aca6d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.171900 Aug 30 02:05:19.282610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 174/351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:19 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:19.845770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:19.846309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:19.848497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:19.854092 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.854574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.855061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:19.855879 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:19.859933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:19.859933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.215954 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:20.231656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e787152c-6a26-407b-9637-1f78a766d4f3 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.389725 Aug 30 02:05:20.247045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 178/352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:19 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:20.303573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:20.304218 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:20.306652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:20.314672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.314672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.314672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.315051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.315308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.315683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.443792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:20.444256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:20.450676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.451171 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.451606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.452318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:20.452774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:20.453196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:20.477203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:20.485764 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3ef5bdd3-8a70-4237-9691-137fb64ad9f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.186059 Aug 30 02:05:20.486548 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 175/353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:20 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:20.599211 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lazy-loading 'services' on Instance uuid 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:21.095281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a18549f2-9ef8-4fb5-b033-df24294c36aa tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-volume_attachments/a2120a55-d39a-47fc-9275-e1f95576a797" status: 202 len: 0 microversion: 2.1 time: 0.655528 Aug 30 02:05:21.096000 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 179/354] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:05:20 2022] DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-volume_attachments/a2120a55-d39a-47fc-9275-e1f95576a797 => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:05:21.256050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:21.256641 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:21.263053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:21.263871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=12 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:21.265755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:21.266241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:21.266671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:21.267423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:21.267853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:21.268267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:21.407711 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:21.416822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ad13454e-677d-4776-be7a-c1d8119714e0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.164870 Aug 30 02:05:21.417891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 176/355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:21 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:21.507522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:21.508258 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:21.515421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:21.515943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:21.516410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:21.517138 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:21.517618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:21.518063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:21.670602 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:21.678472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e1292c3b-1c27-4d49-b6d9-0707adb38f35 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.175230 Aug 30 02:05:21.679038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 180/356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:21 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:22.437881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:22.438421 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:22.445625 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.446104 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.446528 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.447212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.447656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.448072 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.598389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:22.606887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-104b3cdf-bbf2-4fda-888f-6e2bb613342d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.172913 Aug 30 02:05:22.607647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 177/357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:22 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:22.700444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:22.701035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:22.703237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=12 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:22.708079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.708564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.708992 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.709709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:22.710162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:22.710648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:22.856631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:22.865084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ad413c8a-9a46-4248-9bc6-7e7622e3062d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.168772 Aug 30 02:05:22.865922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 181/358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:22 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:23.628491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:23.629419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:23.636935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.637499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.637883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.638592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.639133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.639767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.781417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:23.789239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-880c9212-b3a8-4722-b81b-eea48e20e2ca tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.164983 Aug 30 02:05:23.789835 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 178/359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:23 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:23.896196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:23.896887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:23.904129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.904612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.905042 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:23.905772 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:23.906224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:23.906670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:24.051327 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:24.059591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e099b6f2-a63a-4c22-a63a-fac4589bbdbb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.167386 Aug 30 02:05:24.060153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 182/360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:23 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:24.811206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:24.811870 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:24.818593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:24.819083 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:24.819514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:24.820204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:24.820651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:24.821067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:24.968683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:24.976541 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bc1fe0b5-4972-40de-b4ef-c53638b7c035 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.169931 Aug 30 02:05:24.977118 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 179/361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:24 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:25.080434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:25.080972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:25.087524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:25.088099 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:25.088534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:25.089386 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:25.093782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:25.093782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:25.231208 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:25.238933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4ddadf99-6154-4e2c-879d-7489943ceb11 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.162431 Aug 30 02:05:25.239580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 183/362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:25 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:26.010762 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:26.011491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:26.018766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.019258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.019695 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.020398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.020853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.021277 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.259822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:26.261101 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:26.268927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.269426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.269882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.270584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.271039 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.271459 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.337268 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:26.345874 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-65956a65-2fc7-4951-9371-57ca38eb6245 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.338780 Aug 30 02:05:26.346451 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 180/363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:26 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:26.418791 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:26.431973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-42206a35-214b-41d3-9536-c8eb4e4f8d50 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.176241 Aug 30 02:05:26.432785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 184/364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:26 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:26.495043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-2f4ea62f-e3f6-45c0-9607-37891bc521ac req-d7141995-0af4-47d9-be3e-35035197e4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728f5c90-fe26-42ce-8704-fc0473f19043", "tag": "6c53ac5d-91fb-4691-8545-491e6ea0ecb9"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:26.505547 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2f4ea62f-e3f6-45c0-9607-37891bc521ac req-d7141995-0af4-47d9-be3e-35035197e4fb service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:26.505992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2f4ea62f-e3f6-45c0-9607-37891bc521ac req-d7141995-0af4-47d9-be3e-35035197e4fb service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:26.508898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2f4ea62f-e3f6-45c0-9607-37891bc521ac req-d7141995-0af4-47d9-be3e-35035197e4fb service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:26.517972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-2f4ea62f-e3f6-45c0-9607-37891bc521ac req-d7141995-0af4-47d9-be3e-35035197e4fb service nova] Creating event network-changed:6c53ac5d-91fb-4691-8545-491e6ea0ecb9 for instance 728f5c90-fe26-42ce-8704-fc0473f19043 on hv-cinder-81966 Aug 30 02:05:26.522971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-2f4ea62f-e3f6-45c0-9607-37891bc521ac req-d7141995-0af4-47d9-be3e-35035197e4fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032000 Aug 30 02:05:26.523906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 181/365] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:27.367392 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:27.368047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.374755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.375238 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.375669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.376378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.376823 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.377238 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.460645 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:27.461345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.469571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.469922 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.470360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.471057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.471511 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.472186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.531816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:27.544088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9727e816-aede-4851-8792-34e7f6e18e8e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.180424 Aug 30 02:05:27.544732 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 185/366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:27 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:27.557556 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b40944e8-718e-48cd-bc99-7f5fde4e0994 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:27.564802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b40944e8-718e-48cd-bc99-7f5fde4e0994 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.565412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b40944e8-718e-48cd-bc99-7f5fde4e0994 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.565939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b40944e8-718e-48cd-bc99-7f5fde4e0994 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.590272 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b40944e8-718e-48cd-bc99-7f5fde4e0994 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Going to try to stop instance {{(pid=121094) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 02:05:27.640841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:27.648454 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-511fa4b9-867e-4c88-93db-271f588d3431 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.193440 Aug 30 02:05:27.649010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 182/367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:27 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:27.841966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b40944e8-718e-48cd-bc99-7f5fde4e0994 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action" status: 202 len: 0 microversion: 2.1 time: 0.287969 Aug 30 02:05:27.842491 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 186/368] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:05:27 2022] POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:05:27.850926 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:27.851541 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:27.858272 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.858753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.859190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.859885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:27.860340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:27.860764 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:27.991725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:28.000261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f4818cf7-b280-441f-86e6-10db312a61f0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.153221 Aug 30 02:05:28.000822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 183/369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:27 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:28.568857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:28.569568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:28.576034 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.576514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.576950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.577756 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.578210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.578687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.671385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:28.672708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:28.679435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.679926 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.680365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.681075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:28.681579 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:28.682011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:28.723924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:28.732689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5da90109-871c-4603-b012-c2ded3fd7bd6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.168390 Aug 30 02:05:28.733386 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 187/370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:28 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:28.824325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:28.831903 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6d2b71d8-90bb-4253-a219-06cc9d8ce28d tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.166352 Aug 30 02:05:28.832467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 184/371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:28 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:29.021468 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:29.022081 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:29.029575 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.034134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.034134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.034134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.034134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.034625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.165972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:29.174445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3c7e8f99-b79c-4aed-88a5-9ae01d4c17fb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.156751 Aug 30 02:05:29.175016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 188/372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:29 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:29.754311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:29.754926 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:29.762120 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.762621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.763054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.763739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.764196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.764611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.858329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:29.858943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:29.865139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.865660 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.866096 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.866802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:29.867252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:29.867665 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:29.899772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:29.917294 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b62c0fa0-979c-45b7-908e-de95a98b2a00 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.166566 Aug 30 02:05:29.918276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 185/373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:29 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:30.013164 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:30.020943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-10203472-4431-4660-b4a1-cc9888b95832 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.168516 Aug 30 02:05:30.021531 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 189/374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:29 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:30.195365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:30.195888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:30.201977 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.202459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.202891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.203590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.204039 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.204457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.338579 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:30.346988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-48ca1d41-20ed-40d1-8968-36344fa8355e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.155607 Aug 30 02:05:30.347566 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 186/375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:30 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:30.938570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:30.939187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:30.945662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.946147 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.946583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:30.947281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:30.947735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:30.948162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.041940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:31.043220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:31.052367 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.052865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.053701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.054625 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.055089 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.055837 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.074715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:31.089485 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:31.109547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b0a2932a-d608-4300-8dc3-62958fe71951 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.174781 Aug 30 02:05:31.110293 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 190/376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:30 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:31.197335 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:31.206219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2d8c7ab3-b5ff-4e09-9fcf-1823affc597b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.168057 Aug 30 02:05:31.206795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 187/377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:31 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:31.368843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:31.369605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:31.376031 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.376513 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.376941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.377656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:31.378107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:31.378569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:31.523755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:31.531761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-92462fab-89f6-4ba7-bd10-cd28175ddc22 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.166996 Aug 30 02:05:31.532410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 191/378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:31 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:32.132199 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:32.132966 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:32.140326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.140811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.141270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.142074 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.142524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.142979 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.228116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:32.228818 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:32.237123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.237724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.238227 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.239969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.239969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.239969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.289097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:32.298147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ca691876-18c3-44a5-a19e-1b2a1423d380 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.169752 Aug 30 02:05:32.298728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 188/379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:32 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:32.417082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:32.421310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:32.426474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a7fae33e-3c16-4b32-a72e-d8d7e52f17f0 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.202874 Aug 30 02:05:32.427059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 192/380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:32 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:32.553433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:32.554108 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:32.561034 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.561697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.562179 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.562969 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:32.563470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:32.563958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:32.695541 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:32.703729 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-144c19b5-8d07-4e43-b2b9-7939827ff678 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.154104 Aug 30 02:05:32.704534 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 189/381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:32 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:33.318849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:33.319459 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:33.327199 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.327686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.328119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.328816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.329268 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.329714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.451121 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:33.451823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:33.458583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.459271 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.459859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.460684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.461154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.461616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.471265 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:33.479374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a11d8273-ce21-41bd-bb23-93294b73fb5f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.164487 Aug 30 02:05:33.480024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 193/382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:33 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:33.600843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:33.609027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-866b13da-afbb-4e9b-9a56-e33b29e8d465 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.162342 Aug 30 02:05:33.609624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 190/383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:33 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:33.726149 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:33.727039 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:33.733326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.733849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.734278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.734977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:33.735424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:33.735842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:33.875538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:33.883378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-72f05816-87b1-45b2-b114-7c4f1d10fc66 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.161554 Aug 30 02:05:33.883950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 194/384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:33 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:34.029763 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-cf539981-a4e6-4f73-9d7e-357e6613c918 req-9e7c70ce-4a67-4d1a-bd20-1e14dbc311c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728f5c90-fe26-42ce-8704-fc0473f19043", "name": "network-vif-plugged", "status": "completed", "tag": "6c53ac5d-91fb-4691-8545-491e6ea0ecb9"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:34.039992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cf539981-a4e6-4f73-9d7e-357e6613c918 req-9e7c70ce-4a67-4d1a-bd20-1e14dbc311c3 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.040468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cf539981-a4e6-4f73-9d7e-357e6613c918 req-9e7c70ce-4a67-4d1a-bd20-1e14dbc311c3 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.040892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cf539981-a4e6-4f73-9d7e-357e6613c918 req-9e7c70ce-4a67-4d1a-bd20-1e14dbc311c3 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.052939 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-cf539981-a4e6-4f73-9d7e-357e6613c918 req-9e7c70ce-4a67-4d1a-bd20-1e14dbc311c3 service nova] Creating event network-vif-plugged:6c53ac5d-91fb-4691-8545-491e6ea0ecb9 for instance 728f5c90-fe26-42ce-8704-fc0473f19043 on hv-cinder-81966 Aug 30 02:05:34.057982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-cf539981-a4e6-4f73-9d7e-357e6613c918 req-9e7c70ce-4a67-4d1a-bd20-1e14dbc311c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Aug 30 02:05:34.059206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 191/385] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:34.509054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:34.509706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:34.516755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.517241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.517708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.518410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.518861 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.519281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.632971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:34.633884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:34.640761 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.641246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.641700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.642399 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.642853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.643269 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.653343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:34.661049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4f40c2f8-f6d9-4e7f-b519-16955780b75b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.157223 Aug 30 02:05:34.661847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 195/386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:34 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:34.782890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:34.790494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9b0c55b1-96b6-4a5e-b658-4a089c633a36 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.162595 Aug 30 02:05:34.791051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 192/387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:34 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:34.905486 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:34.906111 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:34.912306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.912791 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.913221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:34.913957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:34.914425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:34.914834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.060384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:35.068776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c7d45804-5c84-459d-8ddc-3b892e3f3a0c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.167735 Aug 30 02:05:35.069361 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 196/388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:34 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:35.683373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:35.684345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:35.691688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:35.692194 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:35.692631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.693347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:35.693831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:35.694263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.813089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:35.813742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:35.820255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:35.820473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:35.820861 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.821628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:35.822225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:35.822652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:35.836755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:35.847915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e250222d-510f-4ef6-93c0-a1e5f63d8221 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1317 microversion: 2.1 time: 0.168104 Aug 30 02:05:35.848925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 193/389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:35 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:35.968368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:35.976585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2d61b861-95c4-4d81-8e28-7d70e5ca5200 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.167411 Aug 30 02:05:35.979676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 197/390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:35 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:36.076295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-53845e26-de2e-4e09-b529-f8b74a732e69 req-8682f2da-dabb-472d-8add-0596e99929f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "name": "network-vif-plugged", "status": "completed", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:36.086263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-53845e26-de2e-4e09-b529-f8b74a732e69 req-8682f2da-dabb-472d-8add-0596e99929f6 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.088618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-53845e26-de2e-4e09-b529-f8b74a732e69 req-8682f2da-dabb-472d-8add-0596e99929f6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.088618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-53845e26-de2e-4e09-b529-f8b74a732e69 req-8682f2da-dabb-472d-8add-0596e99929f6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.090931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:36.091750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:36.097902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.098503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.098947 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.099315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-53845e26-de2e-4e09-b529-f8b74a732e69 req-8682f2da-dabb-472d-8add-0596e99929f6 service nova] Creating event network-vif-plugged:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:05:36.099656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.100114 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.100579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.104257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-53845e26-de2e-4e09-b529-f8b74a732e69 req-8682f2da-dabb-472d-8add-0596e99929f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031833 Aug 30 02:05:36.104844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 194/391] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:36.241291 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:36.250183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0fc5303a-56ef-446f-a79f-ea3dad9dc118 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.163397 Aug 30 02:05:36.250760 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 198/392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:36 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:36.882077 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:36.882802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:36.889941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.890428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.890861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.891560 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:36.892015 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:36.892440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:36.998232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:36.998845 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:37.005478 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.005964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.006398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.007096 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.007550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.007978 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.021870 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:37.031048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f9591bdd-03a2-49c2-8b5d-631cc6a87bec tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1506 microversion: 2.1 time: 0.153057 Aug 30 02:05:37.031562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 195/393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:36 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:37.161050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:37.170182 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f6ac1638-d74f-400d-8e47-2a4a92bd1b84 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1357 microversion: 2.1 time: 0.176138 Aug 30 02:05:37.171011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 199/394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:36 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:37.272252 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:37.272873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:37.279598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.280080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.280708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.281433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.281911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.282360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.425577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:37.435237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d61ca327-624c-4b31-88b7-c8fc72b82f9a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.166985 Aug 30 02:05:37.439634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 196/395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:37 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:37.833950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:37.834752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:37.844802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.845301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.845775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.846503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.847022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.847688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.875004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c306ac20-c536-46fc-be1b-1ea9279c388c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.044870 Aug 30 02:05:37.875675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 200/396] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:05:37 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:37.888005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2fed156-5a93-4efa-a114-0bb83bd398f5"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:37.892058 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:37.896984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.897484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.897952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.899442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:37.899804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:37.900347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:37.988060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Invalid volume: volume e2fed156-5a93-4efa-a114-0bb83bd398f5 is already attached to instances: fa5b872f-9744-43a4-94bc-1f6c488c692d Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: POST /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/os-volume_attachments HTTP/1.1 Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 74 Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:05:37.989943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {"volumeAttachment": {"volumeId": "e2fed156-5a93-4efa-a114-0bb83bd398f5"}} Aug 30 02:05:37.991484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Invalid volume: volume e2fed156-5a93-4efa-a114-0bb83bd398f5 is already attached to instances: fa5b872f-9744-43a4-94bc-1f6c488c692d Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'server_id': 'e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4', 'body': {'volumeAttachment': {'volumeId': 'e2fed156-5a93-4efa-a114-0bb83bd398f5'}}} Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e2fed156-5a93-4efa-a114-0bb83bd398f5 is already attached to instances: fa5b872f-9744-43a4-94bc-1f6c488c692d Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:37.992440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e2fed156-5a93-4efa-a114-0bb83bd398f5 is already attached to instances: fa5b872f-9744-43a4-94bc-1f6c488c692d Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:37.993960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e2fed156-5a93-4efa-a114-0bb83bd398f5 is already attached to instances: fa5b872f-9744-43a4-94bc-1f6c488c692d Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 400 to user: Invalid volume: volume e2fed156-5a93-4efa-a114-0bb83bd398f5 is already attached to instances: fa5b872f-9744-43a4-94bc-1f6c488c692d {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-89f92fd8-5dd9-42e5-9618-0e8feb46de70 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107953 Aug 30 02:05:37.995459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 197/397] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:05:37 2022] POST /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:05:38.001718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.002239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.008637 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.009118 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.009604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.010305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.010751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.011180 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.043385 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:05:38.192201 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.192727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.200095 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.200645 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.201083 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.201901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.202388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.202816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.351604 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.360293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-331084c0-b306-46e4-8263-2670d24ec391 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1548 microversion: 2.1 time: 0.171957 Aug 30 02:05:38.360862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:38.382357 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.390996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.390996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.390996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.391605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.392388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.393117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.393382 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.449916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-10003382-f686-4add-aec1-29037a9f798b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 204 len: 0 microversion: 2.1 time: 0.450785 Aug 30 02:05:38.458273 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 201/399] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:05:37 2022] DELETE /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:05:38.469617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.470740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.480606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.481381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.486233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.486233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.486233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.486233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.583358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.594257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-782e42ac-1c0e-4900-ba21-ca5714247aa9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1548 microversion: 2.1 time: 0.215687 Aug 30 02:05:38.612191 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 199/400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:38.625987 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.627013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.633716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.634208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.634642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.635538 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.636170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.636763 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.662721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.671856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7f1ff376-3844-4e6d-96ce-6109fe77790a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1682 microversion: 2.1 time: 0.211353 Aug 30 02:05:38.672447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 202/401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:38.676975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.681927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.682849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Searching by: {'deleted': False, 'project_id': 'b6200be9acd14756908c3fd33adf1506'} {{(pid=121094) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 02:05:38.690407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.690894 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.691327 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.692244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.692901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.693315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.788426 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:38.798045 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0def8e70-d822-4603-b472-3b6c0a037a74 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.184558 Aug 30 02:05:38.798630 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 200/402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:38.801719 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.multi_cell_list [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121094) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 02:05:38.922440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8e9d3e5f-5cf4-4a81-a527-f3bebf3fff77 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.248851 Aug 30 02:05:38.923088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 203/403] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:38.934947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:38.935555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:38.941677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.942157 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.942583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:38.943274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:38.943721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:38.944140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.095664 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:39.103837 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b8f63a73-911e-43e0-8f86-a8b3a7bca7f1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1548 microversion: 2.1 time: 0.173284 Aug 30 02:05:39.104411 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 201/404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:38 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:39.698683 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:39.700162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:39.707530 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.708027 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.708468 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.709215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.709707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.714743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.823695 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:39.824386 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:39.831708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.832197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.832824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.833771 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:39.834237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:39.834646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:39.865218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:39.898505 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-72fb985b-3a20-4912-9318-0a9305d401e4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1682 microversion: 2.1 time: 0.203342 Aug 30 02:05:39.908315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 204/405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:39 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:40.029757 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:40.039303 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-315d10a6-db19-496e-8025-d45f5d6f3963 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1679 microversion: 2.1 time: 0.219558 Aug 30 02:05:40.039944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 202/406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:39 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:40.756989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3c3504e-3bfd-473f-bcfc-4279f0035fe7"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:40.759549 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:40.766558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:40.770073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:40.770073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:40.770073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:40.770073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:40.770456 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:40.936961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:40.937599 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:40.944162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:40.944643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:40.945075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:40.945798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:40.946258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:40.946681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.025791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:41.034825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5f3e31d6-828a-41aa-988a-a001e5137c72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1614 microversion: 2.1 time: 0.102412 Aug 30 02:05:41.049266 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 203/407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:40 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:41.065992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:41.067168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:41.075689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.076186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.076614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.077601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.078762 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.079621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.364705 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:41.375983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-395f9b36-090b-4647-96a9-50c6b6fd6bce tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1656 microversion: 2.1 time: 0.313560 Aug 30 02:05:41.377687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 204/408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:41 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1656 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:41.387166 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb635ab3-4124-497e-952d-fadae476dbdb"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:41.391608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:41.399905 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.400682 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.406666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.406666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.406666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.406666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.423872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:41.587046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-163ca764-70d7-4511-af12-da97a4d2b03d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833298 Aug 30 02:05:41.604803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 205/409] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:05:40 2022] POST /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:41.623865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-c98cc8d2-363c-4ba1-8cd9-bfa20c3644c6 req-eddf1f25-8876-438d-a8cd-4c6cc8d8d893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4", "name": "network-vif-deleted", "tag": "8b6c3ad2-e81a-4dbf-bc9b-548cbff19569"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:41.685427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-c98cc8d2-363c-4ba1-8cd9-bfa20c3644c6 req-eddf1f25-8876-438d-a8cd-4c6cc8d8d893 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.688406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-c98cc8d2-363c-4ba1-8cd9-bfa20c3644c6 req-eddf1f25-8876-438d-a8cd-4c6cc8d8d893 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.689268 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-c98cc8d2-363c-4ba1-8cd9-bfa20c3644c6 req-eddf1f25-8876-438d-a8cd-4c6cc8d8d893 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.718212 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-c98cc8d2-363c-4ba1-8cd9-bfa20c3644c6 req-eddf1f25-8876-438d-a8cd-4c6cc8d8d893 service nova] Creating event network-vif-deleted:8b6c3ad2-e81a-4dbf-bc9b-548cbff19569 for instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 on hv-cinder-81966 Aug 30 02:05:41.735875 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-c98cc8d2-363c-4ba1-8cd9-bfa20c3644c6 req-eddf1f25-8876-438d-a8cd-4c6cc8d8d893 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120100 Aug 30 02:05:41.750629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 206/410] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:41.755267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-077dc35d-dcc9-4fec-b8ed-63e92dc7d508 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:41.767800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-077dc35d-dcc9-4fec-b8ed-63e92dc7d508 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:41.768799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-077dc35d-dcc9-4fec-b8ed-63e92dc7d508 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:41.769945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-077dc35d-dcc9-4fec-b8ed-63e92dc7d508 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:41.777378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:41.812107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-077dc35d-dcc9-4fec-b8ed-63e92dc7d508 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Going to try to start instance {{(pid=121094) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 02:05:42.097285 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-077dc35d-dcc9-4fec-b8ed-63e92dc7d508 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action" status: 202 len: 0 microversion: 2.1 time: 0.348606 Aug 30 02:05:42.098187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 207/411] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:05:41 2022] POST /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:05:42.120247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:42.121048 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:42.130574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.131310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.131929 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.132812 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.133702 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.134290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.188023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.188023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.188023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.188023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'fault' on Instance uuid e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:42.268989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:42.273201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3faf13e5-8e2c-43b3-a216-fe11230d6926 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1331 microversion: 2.1 time: 0.173622 Aug 30 02:05:42.283455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 208/412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:42 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1331 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:42.289605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:42.290544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:42.298050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.299034 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.299550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.300322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:42.300999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:42.301519 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:42.486908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:42.500187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bb0fc395-c4ac-4af0-a84f-ecd8879911d2 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1665 microversion: 2.1 time: 0.214972 Aug 30 02:05:42.500785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 209/413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:42 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:43.301545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:43.302613 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:43.310451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.310938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.311457 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.312095 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.312585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.313023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.353740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.354219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.354645 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.355193 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'fault' on Instance uuid e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:43.399802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:43.407771 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7fd3ef2e-0c3b-4770-9770-f441247d99fb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 200 len: 1331 microversion: 2.1 time: 0.115041 Aug 30 02:05:43.408343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 210/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:43 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:43.423911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fc49b0ba-f8a0-4777-8478-e0b02e596ada tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.043085 Aug 30 02:05:43.425772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 205/415] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:05:41 2022] POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments => generated 194 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:43.521974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:43.522617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:43.528876 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.529360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.529829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.530527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:43.530985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:43.531410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:43.716721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:43.728824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-02340f78-a8c0-4161-9015-90d95987f3a1 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1665 microversion: 2.1 time: 0.207613 Aug 30 02:05:43.728824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 211/416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:43 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1665 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:44.430909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:44.431598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:44.438780 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.439258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.439697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.440382 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.440829 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.441246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.454430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 HTTP/1.1 Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:05:44.456064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:05:44.457652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4'} Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:05:44.458646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:05:44.460200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:05:44.461529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:05:44.461529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bebeddc8-37bf-431c-b1e5-fb54287daf36 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 404 len: 111 microversion: 2.1 time: 0.031202 Aug 30 02:05:44.461529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 206/417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:44 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:05:44.466776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ce979eca-f388-48f5-b294-70e5cb81495f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '.version_select at 0x7f4736697700>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:44.474047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:44.554813 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ce979eca-f388-48f5-b294-70e5cb81495f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402803310" status: 202 len: 0 microversion: 2.1 time: 0.092062 Aug 30 02:05:44.555392 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 212/418] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 02:05:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402803310 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:05:44.748620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:44.749228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:44.755295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.755820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.756201 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.756995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:44.758814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:44.758814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:44.920567 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:44.932094 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-af39aa2a-a9f2-43ac-b36f-d092ae409e23 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1669 microversion: 2.1 time: 0.187728 Aug 30 02:05:44.933966 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 207/419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:44 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1669 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:45.512574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:45.513244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:45.521337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:45.525256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:45.525256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.525256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:45.525256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:45.525707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.612028 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'services' on Instance uuid fa5b872f-9744-43a4-94bc-1f6c488c692d {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:45.826517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0d5f8cdd-fd68-4269-b358-ff2b83334fd2 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments/e2fed156-5a93-4efa-a114-0bb83bd398f5" status: 202 len: 0 microversion: 2.1 time: 0.318793 Aug 30 02:05:45.827184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 213/420] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:05:45 2022] DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments/e2fed156-5a93-4efa-a114-0bb83bd398f5 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:05:45.836603 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:45.838867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:45.846653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:45.847144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:45.847587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.848300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:45.848759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:45.849183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:45.882669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-96aeeffc-828e-4cca-8748-d0321bae2adf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050923 Aug 30 02:05:45.883237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 208/421] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:45 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:46.896137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:46.898471 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:46.905952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:46.906447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:46.906883 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:46.907650 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:46.908243 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:46.908742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:46.945515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7379418b-7431-405c-bc96-19c2847a1f14 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054098 Aug 30 02:05:46.946097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 214/422] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:46 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:47.964078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:47.968812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:47.978626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:47.979111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:47.979543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:47.980261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:47.980746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:47.981253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:48.011311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ae4403f9-7a0d-4f67-ad7b-e12d83177434 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056520 Aug 30 02:05:48.012369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 209/423] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:47 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:49.024469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:49.026695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:49.029974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:49.035016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:49.035499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:49.035941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:49.036642 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:49.037192 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:49.037659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:49.068917 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a16b51d9-3a8b-4d54-9adc-30d8c051ecca tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048358 Aug 30 02:05:49.069520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 215/424] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:49 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:50.080961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:50.083274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:50.089892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:50.090377 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:50.090814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:50.091505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:50.091959 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:50.092389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:50.137221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bba17bb4-b46d-44a7-a5a5-af6f6ec1ab98 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059595 Aug 30 02:05:50.138046 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 210/425] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:50 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:51.149750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:51.152455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:51.160046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.160538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.160977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.161782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.162242 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.162669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.195668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ebfc2e97-9c85-4a04-9940-263867e84215 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049996 Aug 30 02:05:51.196244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 216/426] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:51 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:51.419776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:51.422034 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:51.428802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.429339 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.429796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.430500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.430951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.431368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.457362 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'flavor' on Instance uuid 0ecaa0bb-82d5-4a54-b0de-3f755d373450 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:05:51.814640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-542294eb-60fa-4ebe-a435-1d48f2ba5161 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/action" status: 200 len: 32 microversion: 2.1 time: 0.398871 Aug 30 02:05:51.815248 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 211/427] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:05:51 2022] POST /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:05:51.831418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:51.832026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:51.838020 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.838505 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.838951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.839866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:51.840390 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:51.840807 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:51.982851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:51.992919 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b4e83afd-2c6d-441b-a31f-03d5fab7fd0c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.165361 Aug 30 02:05:51.993621 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 217/428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:51 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:52.209526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:52.211814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:52.218278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:52.218763 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:52.219189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:52.220146 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:52.220589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:52.221007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:52.252675 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1eac4875-06b1-4a8a-8bf3-e83b0588cc09 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047532 Aug 30 02:05:52.253157 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 212/429] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:52 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:53.020004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:53.021003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:53.037255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.037255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.037255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.037255 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.037667 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.037667 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.186064 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:53.194861 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4402b9f3-6556-47db-be7f-572644057893 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.181697 Aug 30 02:05:53.195444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 218/430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:53 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:53.265369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:53.267700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:53.270255 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=76 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:53.275168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.275648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.276108 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.277325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:53.277816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:53.278233 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:53.311814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b5080243-bac2-4928-ae65-5367323bf702 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050495 Aug 30 02:05:53.312392 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 213/431] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:53 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:54.216759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:54.217380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:54.224364 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.224850 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:54.225287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:54.226176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.226850 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:54.227290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:54.324360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:54.326629 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:54.333223 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.333733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:54.334168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:54.334862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.335311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:54.335727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:54.364347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:54.369275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5d3cd209-b728-404c-b84c-0a89d2e16b38 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049431 Aug 30 02:05:54.370457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 214/432] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:54 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:54.374895 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2afa5c2b-dfb9-47cc-b6e9-e2717b65d545 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.162071 Aug 30 02:05:54.375614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 219/433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:54 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:54.989694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12a4643a-4627-4c3d-a269-b401b1e10ec4", "device": "/dev/sdb"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:05:54.992431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:54.999434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:54.999917 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.000349 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.001054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.001546 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.001965 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.382864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:55.385230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:55.392481 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.400063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.400063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.400063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.400063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.400444 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.427084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9691bee1-377a-419a-8586-868a114ecdb9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Aug 30 02:05:55.427814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 220/434] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:55 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:55.432228 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:55.432828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:55.438695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.439177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.439613 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.440307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:55.440765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:55.441184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:55.582775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:55.592036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-268d39de-42b5-4ad1-95b1-998904e796f0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.163243 Aug 30 02:05:55.592661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 221/435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:55 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:55.802078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bf885a21-b2b9-4f08-beb0-c9a52157fe03 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "POST /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816364 Aug 30 02:05:55.803689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 215/436] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:05:54 2022] POST /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:56.440111 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:56.442277 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:56.448962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:56.449447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:56.449902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:56.450593 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:56.451046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:56.451469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:56.467996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:56.485624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6c5ef589-6f42-4e09-8379-bafe98261753 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Aug 30 02:05:56.486197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 222/437] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:56 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:56.625268 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:56.625990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:56.632417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:56.632898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:56.633333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:56.634093 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:56.635758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:56.636251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:56.788569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:56.797665 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ac9bb267-7680-4a77-96df-ac265b96c2ee tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.177922 Aug 30 02:05:56.798231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 216/438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:56 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:57.499356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:57.501490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:57.508318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:57.508790 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:57.509217 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:57.509932 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:57.510380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:57.510798 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:57.540695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0263925b-27fd-43cb-9d00-c452e912913e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046317 Aug 30 02:05:57.541250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 223/439] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:57 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:05:57.821993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:57.822711 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:57.829267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:57.829795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:57.830241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:57.830938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:57.831400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:57.831828 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:57.961558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:57.970120 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cabe9c79-98a4-452f-8d5e-d7d9be0f24a1 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.151923 Aug 30 02:05:57.970698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 217/440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:57 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:58.469696 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:58.470574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:58.477136 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:58.477656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:58.478089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:58.478802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:58.479428 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:58.479887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:58.553144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:58.555614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:58.561932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:58.562496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:58.562995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:58.563782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:58.564299 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:58.564788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:58.567601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:05:58.604620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6bea3f60-a75a-45ab-9776-f65cc3f7b97c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055508 Aug 30 02:05:58.609110 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 218/441] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:58 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:05:58.632462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:58.642483 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1716511c-3bb6-4f83-ad72-85bde9fc7728 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1594 microversion: 2.1 time: 0.176866 Aug 30 02:05:58.643017 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 224/442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:58 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1594 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:05:58.992227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:58.992951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:59.001129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:59.001654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:59.002212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.002910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:59.003364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:59.003790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.212788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:05:59.221890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-64a7c403-69cd-440b-bb67-b66c4cd690a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.233453 Aug 30 02:05:59.222461 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 219/443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:05:58 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:05:59.619194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:59.619309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:59.626674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:59.627157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:59.627597 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.628379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:59.628839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:59.629262 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.659583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-54e667e5-a893-4cdb-aaa1-d97df053f57f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046885 Aug 30 02:05:59.660256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 225/444] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:05:59 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:05:59.729267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:05:59.729822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:05:59.736775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:59.737267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:59.737745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.738455 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:05:59.738904 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:05:59.739327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:05:59.768325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Going to try to terminate instance {{(pid=121093) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:06:00.210739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-52d72fe5-9ee3-4bae-b5d5-bd239ee7316e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 204 len: 0 microversion: 2.1 time: 0.485090 Aug 30 02:06:00.211395 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 220/445] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:05:59 2022] DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:06:00.220205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:00.220812 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:00.226838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:00.227318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:00.227754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:00.228441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:00.228891 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:00.229311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:00.244728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:00.251842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:00.251842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:00.252055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:00.252344 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:00.253047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:00.253510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:00.253992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:00.366619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:00.374732 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-91b69994-14b3-435b-8616-3f88ef60847e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1681 microversion: 2.1 time: 0.158570 Aug 30 02:06:00.375308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 226/446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:00 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:00.480065 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:00.488521 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4f48a7e6-23c7-4b92-a6e0-d9deb8e4a64b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.247993 Aug 30 02:06:00.489176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 221/447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:00 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:01.311076 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-044f5efe-f40e-429b-8b50-798a0b55a73a req-aa254fbb-43b3-4bf9-8d09-c7fddbb9bd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:01.320872 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-044f5efe-f40e-429b-8b50-798a0b55a73a req-aa254fbb-43b3-4bf9-8d09-c7fddbb9bd98 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.321346 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-044f5efe-f40e-429b-8b50-798a0b55a73a req-aa254fbb-43b3-4bf9-8d09-c7fddbb9bd98 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.321795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-044f5efe-f40e-429b-8b50-798a0b55a73a req-aa254fbb-43b3-4bf9-8d09-c7fddbb9bd98 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.333405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-044f5efe-f40e-429b-8b50-798a0b55a73a req-aa254fbb-43b3-4bf9-8d09-c7fddbb9bd98 service nova] Creating event network-changed:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:06:01.338616 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-044f5efe-f40e-429b-8b50-798a0b55a73a req-aa254fbb-43b3-4bf9-8d09-c7fddbb9bd98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039485 Aug 30 02:06:01.339201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 227/448] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:01.397320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:01.397964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:01.404975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.405478 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.405916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.406611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.407067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.407502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.511235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:01.512727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:01.519427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.520204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.520874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.521737 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:01.522299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:01.522792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:01.550138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:01.559498 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-14581c8e-871b-4e10-8b31-f320323e9096 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1681 microversion: 2.1 time: 0.165969 Aug 30 02:06:01.560127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 222/449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:01 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:01.698794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:01.724874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d23f90a6-4288-4900-a029-03e140d9da38 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.217691 Aug 30 02:06:01.725292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 228/450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:01 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:02.581280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:02.581950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:02.588891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.589470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.589995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.590765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.591312 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.591805 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.746808 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:02.747501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:02.753768 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.754252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.754690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.755383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:02.755836 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:02.756257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:02.822508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:02.830601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7b2d9a71-ea0a-4dd8-9d0f-0c34f99deca9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1681 microversion: 2.1 time: 0.253147 Aug 30 02:06:02.831180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 223/451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:02 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:02.895169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:02.903847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-31dee593-e40d-44d9-8df1-0cd6eb13a1a3 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.160883 Aug 30 02:06:02.904436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 229/452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:02 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:03.455012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-71cc29ff-1498-430f-ac25-a02c448d4c37 req-12c0cc1d-e8b0-4984-b52a-9d576736f878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5b872f-9744-43a4-94bc-1f6c488c692d", "name": "network-vif-deleted", "tag": "f9ed6cf0-0f77-4260-91c6-8234ef158793"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:03.465373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-71cc29ff-1498-430f-ac25-a02c448d4c37 req-12c0cc1d-e8b0-4984-b52a-9d576736f878 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.465948 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-71cc29ff-1498-430f-ac25-a02c448d4c37 req-12c0cc1d-e8b0-4984-b52a-9d576736f878 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.466380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-71cc29ff-1498-430f-ac25-a02c448d4c37 req-12c0cc1d-e8b0-4984-b52a-9d576736f878 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.477800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-71cc29ff-1498-430f-ac25-a02c448d4c37 req-12c0cc1d-e8b0-4984-b52a-9d576736f878 service nova] Creating event network-vif-deleted:f9ed6cf0-0f77-4260-91c6-8234ef158793 for instance fa5b872f-9744-43a4-94bc-1f6c488c692d on hv-cinder-81966 Aug 30 02:06:03.486915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-71cc29ff-1498-430f-ac25-a02c448d4c37 req-12c0cc1d-e8b0-4984-b52a-9d576736f878 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Aug 30 02:06:03.487713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 224/453] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:03.881254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:03.881254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:03.881254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.881254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.882006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.882006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.882006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.882006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.894528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.895009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.895441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.895884 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'fault' on Instance uuid fa5b872f-9744-43a4-94bc-1f6c488c692d {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:03.926720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:03.927260 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:03.935010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.935507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.935942 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.936658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:03.937104 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:03.937747 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:03.942408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:03.949981 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9c6cc59e-68c8-41e2-809a-249876adf6be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 200 len: 1330 microversion: 2.1 time: 0.101544 Aug 30 02:06:03.950541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 230/454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:03 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:04.390483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:04.399635 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c718d55f-9bd7-405a-a739-a5011b1d1611 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.477407 Aug 30 02:06:04.400281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 225/455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:03 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:04.975113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:04.975680 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:04.982165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:04.982648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:04.983142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:04.983837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:04.984290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:04.984714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:04.999113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d HTTP/1.1 Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:06:05.000770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:06:05.002336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'fa5b872f-9744-43a4-94bc-1f6c488c692d'} Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:06:05.003129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:06:05.004508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:05.005905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:06:05.005905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-06f0a971-480a-4df4-8b3e-8a19cf2fb110 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 404 len: 111 microversion: 2.1 time: 0.031000 Aug 30 02:06:05.005905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 231/456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:04 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:06:05.011912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bcdc463a-3f34-46d1-b7e0-2f062228d2b8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '.version_select at 0x7f473680dc10>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:05.147012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1585186633"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:05.147548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:05.153845 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.154332 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.154769 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.155464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.155928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.156353 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.166135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bcdc463a-3f34-46d1-b7e0-2f062228d2b8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922006313" status: 202 len: 0 microversion: 2.1 time: 0.158707 Aug 30 02:06:05.166758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 226/457] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 02:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922006313 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:06:05.283935 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.network.security_group_api [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Adding security group 0585ab8a-3d60-4195-b9b6-d3a8fb293e30 to port d458433e-132c-4f16-ab95-b7d676233c95 Aug 30 02:06:05.422775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:05.422775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:05.429520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.430011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.430441 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.431137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.432200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.432809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.597541 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:05.607070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8446b289-ff28-460b-b0be-3c11b3a04cbe tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.189497 Aug 30 02:06:05.607906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 227/458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:05 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:05.900741 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-712b1b94-a5fe-4e06-a681-914e61dcdeaf tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/action" status: 202 len: 0 microversion: 2.1 time: 0.757607 Aug 30 02:06:05.905712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 232/459] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:06:05 2022] POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:06:05.909519 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-0c11a17e-0dc0-416d-b7e1-d08262497f0c req-3f1c5080-37cb-4acb-9985-55b7f0c483c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:05.910924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:05.911536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:05.920492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.920987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.921427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.922167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.922374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-0c11a17e-0dc0-416d-b7e1-d08262497f0c req-3f1c5080-37cb-4acb-9985-55b7f0c483c5 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:05.922626 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.923054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.923398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-0c11a17e-0dc0-416d-b7e1-d08262497f0c req-3f1c5080-37cb-4acb-9985-55b7f0c483c5 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:05.924004 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-0c11a17e-0dc0-416d-b7e1-d08262497f0c req-3f1c5080-37cb-4acb-9985-55b7f0c483c5 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:05.937518 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-0c11a17e-0dc0-416d-b7e1-d08262497f0c req-3f1c5080-37cb-4acb-9985-55b7f0c483c5 service nova] Creating event network-changed:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:06:05.943509 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-0c11a17e-0dc0-416d-b7e1-d08262497f0c req-3f1c5080-37cb-4acb-9985-55b7f0c483c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037514 Aug 30 02:06:05.944394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 228/460] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:06.148969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:06.158537 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-cfe22dbd-058d-43b2-a3be-cee6db6d2e32 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1760 microversion: 2.1 time: 0.251326 Aug 30 02:06:06.159225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 233/461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:05 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1760 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:06.437920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e1f5b642-bd6d-4014-bbfd-f88ee98a093d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: .version_select at 0x7f47365ba940>, body: {"keypair": {"name": "tempest-keypair-1958612000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7QwLzOCAHWbxfoDMgNkXu872+Ui/GiC4Zwxxy/mFaldxkgcw8NIEU89Ipb4i+F8Pjz5ePjelCRG2gmILKwadnEcBkvjKHReQwfNr5bOO4h681LboHmZAQm0X+WmDomAA=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:06.456182 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-e1f5b642-bd6d-4014-bbfd-f88ee98a093d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:06.460418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-e1f5b642-bd6d-4014-bbfd-f88ee98a093d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:06.630058 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:06.630781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e1f5b642-bd6d-4014-bbfd-f88ee98a093d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.199115 Aug 30 02:06:06.631376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 229/462] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:06:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:06.632127 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:06.650159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:06.651493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:06.652197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:06.653550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:06.653936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:06.654439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:06.791810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:06.800869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b20b5a4b-8977-4fe4-a539-9888c6808a44 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.175308 Aug 30 02:06:06.801436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 234/463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:06 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:07.822134 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:07.822867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:07.829692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.838232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.838232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.838232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:07.838232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:07.838609 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:07.969151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:07.977653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bbe8df7e-6009-4c88-81fe-62d2d9f20ce8 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.159887 Aug 30 02:06:07.978298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 230/464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:07 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:08.999746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:09.000452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:09.006904 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:09.007380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:09.008016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:09.008771 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:09.009229 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:09.009677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:09.167351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:09.175873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5eb4bf0f-a42e-46d0-b11f-429c34f74bd5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.180120 Aug 30 02:06:09.176377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 235/465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:08 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:09.573171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117979975", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316431ff-b22a-409c-830b-a78363ccfbd0"}], "security_groups": [{"name": "tempest-securitygroup--1322841689"}], "key_name": "tempest-keypair-1958612000", "user_data": "}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:09.676181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] validate_networks() for [('316431ff-b22a-409c-830b-a78363ccfbd0', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:06:10.052059 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:06:10.052483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:06:10.052958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:06:10.053420 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:06:10.053856 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:06:10.063740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:10.064266 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:10.064711 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:10.065485 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:10.065950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:10.066375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:10.083876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:10.088289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:10.099768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:06:10.102148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:06:10.196991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:10.197632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:10.204703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:10.206098 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:10.206842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:10.207851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:10.208412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:10.208938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:10.269023 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d142b375-39f1-441a-b47c-48203389d401 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.699886 Aug 30 02:06:10.270531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 231/466] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:06:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:06:10.282018 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6c2ab1ab-b974-4e75-9142-52844b3ab79a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:10.289444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6c2ab1ab-b974-4e75-9142-52844b3ab79a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:10.340098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6c2ab1ab-b974-4e75-9142-52844b3ab79a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:10.347934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6c2ab1ab-b974-4e75-9142-52844b3ab79a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1242 microversion: 2.1 time: 0.069771 Aug 30 02:06:10.348765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 232/467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:10 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:10.379327 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:10.388646 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9cdfbb80-5e5c-4b23-b90a-0e777edcd177 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.195560 Aug 30 02:06:10.389418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 236/468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:10 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:11.370040 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c7185afd-ff6b-40d5-8654-2709351cd597 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:11.371929 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c7185afd-ff6b-40d5-8654-2709351cd597 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:11.410703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:11.411336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:11.418521 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:11.419003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:11.419435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:11.420132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:11.420591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:11.421013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:11.431364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c7185afd-ff6b-40d5-8654-2709351cd597 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:11.439068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c7185afd-ff6b-40d5-8654-2709351cd597 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1242 microversion: 2.1 time: 0.073252 Aug 30 02:06:11.439732 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 233/469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:11 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:11.549544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:11.557964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f06430ff-185f-479d-bfe5-dffa36fe7173 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.151017 Aug 30 02:06:11.559116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 237/470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:11 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:12.459565 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:12.460177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:12.467403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.467887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.468322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.469022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.469499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.469988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.530487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:12.538127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-58a70429-3115-4fd4-b39d-aa5817c51961 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1246 microversion: 2.1 time: 0.082330 Aug 30 02:06:12.538687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 234/471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:12 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:12.580187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:12.580828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:12.587214 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.587691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.588123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.588809 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:12.589323 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:12.590029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:12.728296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:12.736745 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-42bb1b0d-5c89-44df-879c-f40289b7554d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.160339 Aug 30 02:06:12.737319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 238/472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:12 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:13.559776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:13.560376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:13.567022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.567509 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.567943 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.568628 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.569149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.569629 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.630623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:13.638894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a99c13fe-f81e-4dea-b928-c3903f0845b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1246 microversion: 2.1 time: 0.083372 Aug 30 02:06:13.639458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 235/473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:13 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:13.758895 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:13.759502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:13.766471 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.766953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.767384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.768067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:13.768514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:13.768929 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:13.893815 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:13.903109 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a65be528-2f52-40b8-860b-861bc6606402 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.147991 Aug 30 02:06:13.903671 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 239/474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:13 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:14.660168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:14.660774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:14.667147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.668390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.668852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.669573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.670030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.670453 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.735568 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:14.743176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9e9e785d-f036-48f8-ad46-d269aa56debb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1246 microversion: 2.1 time: 0.086837 Aug 30 02:06:14.743728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 236/475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:14 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:14.924595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:14.925137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:14.931462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.931942 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.932376 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.933067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:14.933544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:14.934059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:14.956470 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:15.285727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:15.294782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6731b67d-a0d5-431b-b330-08d2c604bf5e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.374063 Aug 30 02:06:15.295360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 240/476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:14 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:15.764782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:15.765474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:15.771841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:15.772321 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:15.772748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:15.773507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:15.773916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:15.778593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:15.838008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:15.847298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-50167c66-0899-443b-bbd6-046c56648b10 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1246 microversion: 2.1 time: 0.087069 Aug 30 02:06:15.847863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 237/477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:15 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:16.315953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:16.316654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:16.319253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:16.325542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:16.325542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:16.325542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.325878 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:16.326407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:16.326721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.462008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:16.471406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f00fcc06-50e2-48f6-88a8-4f45d89baf16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1737 microversion: 2.1 time: 0.159256 Aug 30 02:06:16.471965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 241/478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:16 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:16.868315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:16.868854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:16.876219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:16.876722 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:16.877137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.877862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:16.878409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:16.878861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:16.943820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:16.952397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c02233ca-3c36-4373-aa1f-7338ad7dcede tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1294 microversion: 2.1 time: 0.088015 Aug 30 02:06:16.952896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 238/479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:16 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:17.492593 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:17.493205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:17.500066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.500552 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.500986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.501710 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.502170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.502595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.633494 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:17.642437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4361e8a9-3a62-444d-a2b2-2281f14ae129 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1717 microversion: 2.1 time: 0.154029 Aug 30 02:06:17.643001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 242/480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:17 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:17.751884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:17.752312 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:17.758200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.758685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.759120 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.759806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.760265 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.760688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.764326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:17.889545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] HTTP exception thrown: Cannot 'detach_volume' instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 while it is in vm_state rescued Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Request method failure captured: Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments/d3c3504e-3bfd-473f-bcfc-4279f0035fe7 HTTP/1.1 Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-j5eMVFWWxeoVc-5Z-GuOXySHRUTux_Ukrnsj75kKbnJP8Al-Cju828nksPBw5nVT3zt1edet8GIOseWj_iM2trtgt0mC0Zo-bKO9lbTjd6b_jB8uDYJIv7BAeYURGbNtdLfie_tdt4XUtDp41_2FmJvOAbTBOcLjiPOcQLrC0NHM Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:06:17.891156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 5e7584fe83684b01baa31ab67edac026 Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:06:17.892692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Cannot 'detach_volume' instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 while it is in vm_state rescued Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'server_id': '0ecaa0bb-82d5-4a54-b0de-3f755d373450', 'id': 'd3c3504e-3bfd-473f-bcfc-4279f0035fe7'} Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:06:17.896707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 while it is in vm_state rescued Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 while it is in vm_state rescued Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:17.904616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Returning 409 to user: Cannot 'detach_volume' instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 while it is in vm_state rescued {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:06:17.905842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4ea2e112-f2b5-49c6-863c-d5b45a33398e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments/d3c3504e-3bfd-473f-bcfc-4279f0035fe7" status: 409 len: 152 microversion: 2.1 time: 0.144731 Aug 30 02:06:17.905842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 239/481] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:06:17 2022] DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments/d3c3504e-3bfd-473f-bcfc-4279f0035fe7 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 02:06:17.906024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:17.906024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:17.908034 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.908511 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.908956 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.909654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.910103 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.910519 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.977725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:17.978337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:17.984510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.984991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.985422 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:17.986133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:17.986586 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:17.987008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.049671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:18.057263 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-242b52d9-d47c-4aec-83dc-385f55c87915 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1294 microversion: 2.1 time: 0.084423 Aug 30 02:06:18.057849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:17 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:18.151944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-760984d3-bf58-40bc-ada0-bac9bc5fd007 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "POST /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/action" status: 202 len: 0 microversion: 2.1 time: 0.254034 Aug 30 02:06:18.152692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 243/483] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:06:17 2022] POST /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:06:18.161198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:18.161854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:18.168392 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:18.168907 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:18.169444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.170153 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:18.170648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:18.171024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:18.302628 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:18.311517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ac613088-9e06-44bb-95e1-17ee97c1e3f7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1725 microversion: 2.1 time: 0.154333 Aug 30 02:06:18.312079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 241/484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:18 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:19.079916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:19.081908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:19.088253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.088740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.089176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.090266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.090726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.091145 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.154639 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:19.162424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5308945d-490d-4756-8ed2-a5ecb4fd93c8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1294 microversion: 2.1 time: 0.087476 Aug 30 02:06:19.162995 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 244/485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:19 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:19.332747 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:19.333313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:19.340683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.341240 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.341549 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.342235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:19.342680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:19.343097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:19.478779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:19.489438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cac7bee1-0390-4c58-8f33-2ff7580b3adc tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1725 microversion: 2.1 time: 0.160557 Aug 30 02:06:19.490019 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 242/486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:19 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:20.184154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:20.184868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:20.191175 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.191651 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.192144 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.192842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.193577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.194005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.259890 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:20.268703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-90dfb6ee-7d4e-43f8-9971-5c51c258aa3a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1302 microversion: 2.1 time: 0.089014 Aug 30 02:06:20.277662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 245/487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:20 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:20.511171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:20.512407 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:20.514364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:20.519661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.520144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.520584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.521634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:20.522092 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:20.522624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:20.762024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:20.770306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7ee3ec6b-fd7b-4349-8313-a06417b8b98e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1725 microversion: 2.1 time: 0.263150 Aug 30 02:06:20.770873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 243/488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:20 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:21.292483 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:21.294008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:21.300958 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.301615 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.302121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.302885 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.303407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.304062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.446166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:21.454889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0bf7f152-d5f2-4aa2-9c9e-0744d3f717d4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.167984 Aug 30 02:06:21.455453 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 246/489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:21 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:21.792220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:21.793537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:21.795476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=14 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:21.796613 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:21.801144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.801675 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.802109 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.802803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:21.803259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:21.803680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:21.939318 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:21.947497 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fa5b5862-6022-44d8-8a32-d3e23738917b tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1725 microversion: 2.1 time: 0.159172 Aug 30 02:06:21.948060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 244/490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:21 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:22.476775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:22.477542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:22.484366 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:22.484855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:22.485288 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:22.486001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:22.486452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:22.486872 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:22.630569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:22.630569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3fbb105c-d5a2-497a-a0bd-1253c0ec0776 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.151605 Aug 30 02:06:22.630569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 247/491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:22 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:22.968869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:22.969507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:22.977429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:22.977961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:22.978403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:22.979105 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:22.979563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:22.979990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.131827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:23.140810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-41df2357-fc39-4d5e-851c-c00129c4cc5f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1725 microversion: 2.1 time: 0.176414 Aug 30 02:06:23.141364 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 245/492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:22 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:23.195983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-1ccf8694-60a7-402a-9dde-829b9986d37b req-f4056c6d-94ac-4e0e-a454-e614c3e5402d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e085f77-4bea-423b-afcd-a2c59f5210db", "tag": "74d417e1-55c5-4a16-8d11-a5c6fa5048b0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:23.207992 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1ccf8694-60a7-402a-9dde-829b9986d37b req-f4056c6d-94ac-4e0e-a454-e614c3e5402d service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.208540 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1ccf8694-60a7-402a-9dde-829b9986d37b req-f4056c6d-94ac-4e0e-a454-e614c3e5402d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.208975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1ccf8694-60a7-402a-9dde-829b9986d37b req-f4056c6d-94ac-4e0e-a454-e614c3e5402d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.221624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-1ccf8694-60a7-402a-9dde-829b9986d37b req-f4056c6d-94ac-4e0e-a454-e614c3e5402d service nova] Creating event network-changed:74d417e1-55c5-4a16-8d11-a5c6fa5048b0 for instance 5e085f77-4bea-423b-afcd-a2c59f5210db on hv-cinder-81966 Aug 30 02:06:23.227148 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-1ccf8694-60a7-402a-9dde-829b9986d37b req-f4056c6d-94ac-4e0e-a454-e614c3e5402d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035971 Aug 30 02:06:23.227751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 248/493] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:23.647374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:23.648440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:23.657494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.658038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.658468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.659155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:23.659613 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:23.660260 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:23.876749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:23.884950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0146db08-ac2c-4fa2-8107-b26269b63d16 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.241945 Aug 30 02:06:23.885539 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 246/494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:23 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:24.163341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:24.164066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:24.170963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.171445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.171893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.172585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.173040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.173488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.306592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:24.314867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-61869233-2bb5-4bf4-9ad1-c954b90f9801 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1731 microversion: 2.1 time: 0.155785 Aug 30 02:06:24.315426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 249/495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:24 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:24.335940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:24.336450 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:24.343591 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.344115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.344500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.345255 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.345733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.346418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.422847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b95882ce-c136-42a3-a768-c9adb031b4a6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090756 Aug 30 02:06:24.423433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 247/496] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:06:24 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:24.595568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:24.596252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:24.602321 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.602803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.603235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.603921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.604371 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.604789 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.689426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lazy-loading 'services' on Instance uuid 728f5c90-fe26-42ce-8704-fc0473f19043 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:24.906784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:24.907330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:24.913902 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.914386 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.914810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.915499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:24.915945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:24.916358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:24.919793 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f95d62eb-bdcd-439d-b23a-1b37c894360d tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "DELETE /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043/os-volume_attachments/12a4643a-4627-4c3d-a269-b401b1e10ec4" status: 202 len: 0 microversion: 2.1 time: 0.327987 Aug 30 02:06:24.920651 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 250/497] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:06:24 2022] DELETE /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043/os-volume_attachments/12a4643a-4627-4c3d-a269-b401b1e10ec4 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:06:25.094332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:25.102786 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5de1faa6-8208-4d4c-86af-4ebeb9c9c5ee tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.200660 Aug 30 02:06:25.103351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 248/498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:24 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:25.654062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-430b8077-0a18-482c-a985-eb8ea1dfd0e7 req-85aaa61d-6807-4627-8cdb-7ccc41a84d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecaa0bb-82d5-4a54-b0de-3f755d373450", "tag": "0613d132-cca5-44d5-80b4-de90c29f8aa0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:25.663843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-430b8077-0a18-482c-a985-eb8ea1dfd0e7 req-85aaa61d-6807-4627-8cdb-7ccc41a84d0b service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:25.664330 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-430b8077-0a18-482c-a985-eb8ea1dfd0e7 req-85aaa61d-6807-4627-8cdb-7ccc41a84d0b service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:25.664959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-430b8077-0a18-482c-a985-eb8ea1dfd0e7 req-85aaa61d-6807-4627-8cdb-7ccc41a84d0b service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:25.676837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-430b8077-0a18-482c-a985-eb8ea1dfd0e7 req-85aaa61d-6807-4627-8cdb-7ccc41a84d0b service nova] Creating event network-changed:0613d132-cca5-44d5-80b4-de90c29f8aa0 for instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 on hv-cinder-81966 Aug 30 02:06:25.681641 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-430b8077-0a18-482c-a985-eb8ea1dfd0e7 req-85aaa61d-6807-4627-8cdb-7ccc41a84d0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032939 Aug 30 02:06:25.682231 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 251/499] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:06:26.126322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:26.127839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:26.136431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:26.137870 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:26.138697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:26.139612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:26.140267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:26.140889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:26.364084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:26.373086 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ba934734-280e-4bb8-8388-d755f467824f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.252487 Aug 30 02:06:26.374454 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 249/500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:26 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:27.112061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:27.112676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:27.119233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.122750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.122750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.122750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.122750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.123101 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.148072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:06:27.394731 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:27.395289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:27.401679 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.402852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.403640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.404420 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.404884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.405317 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.457153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1c95fc08-4f18-4ab1-ab94-cf4f433da813 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "DELETE /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 204 len: 0 microversion: 2.1 time: 0.350674 Aug 30 02:06:27.457766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 252/501] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:06:27 2022] DELETE /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:06:27.467396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:27.468128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:27.474224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.474711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.475153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.475852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.476314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.476740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.551463 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:27.559715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-59400d0f-81c0-4b3b-8405-330a58dc8fbc tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.168801 Aug 30 02:06:27.560290 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 250/502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:27 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:27.624572 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:27.632670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ff710ee5-9c45-427c-ae3f-bae0e3d0a76e tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1512 microversion: 2.1 time: 0.170419 Aug 30 02:06:27.633224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 253/503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:27 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:27.698693 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-71c2fe2a-b860-437a-a8f3-6435b62a3d4a req-a666b324-3e3f-44a2-abd1-e37b3fe0d570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecaa0bb-82d5-4a54-b0de-3f755d373450", "tag": "0613d132-cca5-44d5-80b4-de90c29f8aa0"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:27.708139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-71c2fe2a-b860-437a-a8f3-6435b62a3d4a req-a666b324-3e3f-44a2-abd1-e37b3fe0d570 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:27.708719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-71c2fe2a-b860-437a-a8f3-6435b62a3d4a req-a666b324-3e3f-44a2-abd1-e37b3fe0d570 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:27.709167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-71c2fe2a-b860-437a-a8f3-6435b62a3d4a req-a666b324-3e3f-44a2-abd1-e37b3fe0d570 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:27.720977 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-71c2fe2a-b860-437a-a8f3-6435b62a3d4a req-a666b324-3e3f-44a2-abd1-e37b3fe0d570 service nova] Creating event network-changed:0613d132-cca5-44d5-80b4-de90c29f8aa0 for instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 on hv-cinder-81966 Aug 30 02:06:27.726826 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-71c2fe2a-b860-437a-a8f3-6435b62a3d4a req-a666b324-3e3f-44a2-abd1-e37b3fe0d570 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031750 Aug 30 02:06:27.727404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 251/504] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:28.479669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-bbf2daba-dadb-4ce2-b925-1f8c9730a6c4 req-001fb509-3cf3-49be-a609-5ed308bcddf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e085f77-4bea-423b-afcd-a2c59f5210db", "name": "network-vif-plugged", "status": "completed", "tag": "74d417e1-55c5-4a16-8d11-a5c6fa5048b0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:28.489977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-bbf2daba-dadb-4ce2-b925-1f8c9730a6c4 req-001fb509-3cf3-49be-a609-5ed308bcddf5 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.490455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-bbf2daba-dadb-4ce2-b925-1f8c9730a6c4 req-001fb509-3cf3-49be-a609-5ed308bcddf5 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.490883 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-bbf2daba-dadb-4ce2-b925-1f8c9730a6c4 req-001fb509-3cf3-49be-a609-5ed308bcddf5 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.502065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-bbf2daba-dadb-4ce2-b925-1f8c9730a6c4 req-001fb509-3cf3-49be-a609-5ed308bcddf5 service nova] Creating event network-vif-plugged:74d417e1-55c5-4a16-8d11-a5c6fa5048b0 for instance 5e085f77-4bea-423b-afcd-a2c59f5210db on hv-cinder-81966 Aug 30 02:06:28.506720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-bbf2daba-dadb-4ce2-b925-1f8c9730a6c4 req-001fb509-3cf3-49be-a609-5ed308bcddf5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030806 Aug 30 02:06:28.507297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 254/505] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:28.580854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:28.581580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:28.588155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.588639 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.591149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.591149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.591149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.591149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.658644 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:28.659338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:28.665550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.666067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.666503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.667196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:28.668203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:28.669093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:28.725587 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:28.734001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-dcaeb507-9d79-4bed-868f-b945bf3495ea tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.157303 Aug 30 02:06:28.734575 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 252/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:28 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:28.797648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:28.801116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:28.805645 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9e5df230-c5bb-467d-a0e4-d37256de5d8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1512 microversion: 2.1 time: 0.151287 Aug 30 02:06:28.806210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 255/507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:28 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:29.755514 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:29.756170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:29.763095 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:29.763573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:29.764003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:29.764693 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:29.765145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:29.765599 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:29.833893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:29.834502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:29.841406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:29.841908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:29.842345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:29.843050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:29.843503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:29.844294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:29.982430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:29.986662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:29.990767 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-34a282d1-5603-4bf3-a1b3-b65be6594c87 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1512 microversion: 2.1 time: 0.161091 Aug 30 02:06:29.994508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-31a68efd-f45f-4add-8670-1c7dceb63525 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.242910 Aug 30 02:06:30.005086 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 253/508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:29 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:30.005249 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 256/509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:29 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:30.165775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-24183029-088b-4f23-a76a-65ca5517b0c6 req-1a764c60-d971-4f61-826c-b57f00450afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728f5c90-fe26-42ce-8704-fc0473f19043", "name": "network-vif-deleted", "tag": "6c53ac5d-91fb-4691-8545-491e6ea0ecb9"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:30.176259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-24183029-088b-4f23-a76a-65ca5517b0c6 req-1a764c60-d971-4f61-826c-b57f00450afa service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:30.176728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-24183029-088b-4f23-a76a-65ca5517b0c6 req-1a764c60-d971-4f61-826c-b57f00450afa service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:30.177148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-24183029-088b-4f23-a76a-65ca5517b0c6 req-1a764c60-d971-4f61-826c-b57f00450afa service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:30.188614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-24183029-088b-4f23-a76a-65ca5517b0c6 req-1a764c60-d971-4f61-826c-b57f00450afa service nova] Creating event network-vif-deleted:6c53ac5d-91fb-4691-8545-491e6ea0ecb9 for instance 728f5c90-fe26-42ce-8704-fc0473f19043 on hv-cinder-81966 Aug 30 02:06:30.193391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-24183029-088b-4f23-a76a-65ca5517b0c6 req-1a764c60-d971-4f61-826c-b57f00450afa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031297 Aug 30 02:06:30.193998 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 254/510] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:31.013675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:31.014194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:31.016867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:31.017588 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:31.020663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.021162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.021602 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.022337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.022787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.023207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.023732 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.024206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.024632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.025314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.025801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.026216 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.055073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:31.055550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:31.055980 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:31.056429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lazy-loading 'fault' on Instance uuid 728f5c90-fe26-42ce-8704-fc0473f19043 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:31.100201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:31.108622 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f9656076-4817-4d06-809a-fd56c5663195 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1307 microversion: 2.1 time: 0.098910 Aug 30 02:06:31.109195 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 257/511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:31 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:31.169150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:31.174993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ed5d4fd4-b680-4918-9d1f-9ef8a3cf9c01 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1368 microversion: 2.1 time: 0.162739 Aug 30 02:06:31.175558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 255/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:31 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:32.130328 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:32.131031 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:32.138618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.139096 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.139606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.140270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.140722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.141145 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.173764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.174248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.174680 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.175127 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lazy-loading 'fault' on Instance uuid 728f5c90-fe26-42ce-8704-fc0473f19043 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:32.195759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:32.196394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:32.203408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.203881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.204309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.205003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.205450 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.205893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.218936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:32.226830 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-382c0645-555f-4537-a515-e75481b49b15 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 200 len: 1307 microversion: 2.1 time: 0.100672 Aug 30 02:06:32.227405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 258/513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:32 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:32.339276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:32.347972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-547a4fa6-70cb-4f91-baf2-b8f83baec048 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1559 microversion: 2.1 time: 0.156048 Aug 30 02:06:32.348532 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 256/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:32 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:32.368131 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:32.368653 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:32.374735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.375221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.375654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.376372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:32.376828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:32.377252 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:32.456022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-697660b3-f45a-452f-a334-973e19cc3d4a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091684 Aug 30 02:06:32.456617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 259/515] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:06:32 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:33.249230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:33.249993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: 728f5c90-fe26-42ce-8704-fc0473f19043] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:33.256975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:33.257938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:33.258050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:33.258711 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:33.259166 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:33.259593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:33.273729 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] HTTP exception thrown: Instance 728f5c90-fe26-42ce-8704-fc0473f19043 could not be found. Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Request method failure captured: Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 HTTP/1.1 Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXBSELAsNyHkxffHO4bpWHeVDs_REJV5FJ22Ay57-5sWWdmO5ZXbx21lrjuylBYsOIHUj_ovXj6qax5E5pifPE5SD7FESuNPDTuQ50yisBxRDS7aXG-8QdodHQEhcdPdUEv-CgVaifWaOBITIdmYDhSyF1o6wXNlo7Jv_bUk7d5g4Pg Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: 072e2c259a164ecaa45b5ff18fa3ac66 Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1794144427 Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:06:33.275285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-VolumesSnapshotTestJSON-1794144427 Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: 072e2c259a164ecaa45b5ff18fa3ac66 Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1794144427 Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-VolumesSnapshotTestJSON-1794144427-project Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 789377907cfd4f0f9d3123f6418163f7 Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-VolumesSnapshotTestJSON-1794144427-project Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 728f5c90-fe26-42ce-8704-fc0473f19043 could not be found. Aug 30 02:06:33.276737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '728f5c90-fe26-42ce-8704-fc0473f19043'} Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 728f5c90-fe26-42ce-8704-fc0473f19043 could not be found. Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:06:33.277906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 728f5c90-fe26-42ce-8704-fc0473f19043 could not be found. Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 728f5c90-fe26-42ce-8704-fc0473f19043 could not be found. Aug 30 02:06:33.279668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:06:33.280735 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Returning 404 to user: Instance 728f5c90-fe26-42ce-8704-fc0473f19043 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:06:33.280735 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7737d9ec-201d-47fe-b3bc-9d233b0267c0 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043" status: 404 len: 111 microversion: 2.1 time: 0.032372 Aug 30 02:06:33.280735 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 257/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:33 2022] GET /compute/v2.1/servers/728f5c90-fe26-42ce-8704-fc0473f19043 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:06:33.468237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-cc9b4eba-b4df-430d-834e-dfcce601e72c req-694b5e32-f881-4691-a58f-7099ff4e7cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e085f77-4bea-423b-afcd-a2c59f5210db", "tag": "74d417e1-55c5-4a16-8d11-a5c6fa5048b0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:33.478790 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-cc9b4eba-b4df-430d-834e-dfcce601e72c req-694b5e32-f881-4691-a58f-7099ff4e7cd1 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:33.479384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-cc9b4eba-b4df-430d-834e-dfcce601e72c req-694b5e32-f881-4691-a58f-7099ff4e7cd1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:33.479899 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-cc9b4eba-b4df-430d-834e-dfcce601e72c req-694b5e32-f881-4691-a58f-7099ff4e7cd1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:33.492441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-cc9b4eba-b4df-430d-834e-dfcce601e72c req-694b5e32-f881-4691-a58f-7099ff4e7cd1 service nova] Creating event network-changed:74d417e1-55c5-4a16-8d11-a5c6fa5048b0 for instance 5e085f77-4bea-423b-afcd-a2c59f5210db on hv-cinder-81966 Aug 30 02:06:33.497830 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-cc9b4eba-b4df-430d-834e-dfcce601e72c req-694b5e32-f881-4691-a58f-7099ff4e7cd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034266 Aug 30 02:06:33.498321 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 260/517] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:35.131749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:35.134036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:35.140925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:35.141405 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:35.141866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:35.142553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:35.143004 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:35.143423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:35.146115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:35.403244 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ff6bf1f4-a710-4d24-a3c2-70b53ab48fb2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/action" status: 202 len: 0 microversion: 2.1 time: 0.274596 Aug 30 02:06:35.403878 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 258/518] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:06:35 2022] POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:06:35.413160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:35.413901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:35.420488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:35.420996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:35.421432 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:35.422151 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:35.422608 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:35.423032 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:35.570558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:35.579515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-25d359e5-0b87-4a64-8382-7e6689a75191 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1752 microversion: 2.1 time: 0.171293 Aug 30 02:06:35.580082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 261/519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:35 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:36.601436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:36.602161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:36.608977 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:36.609474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:36.609904 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:36.610584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:36.611032 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:36.611446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:36.757702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:36.766293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5e15f762-c4e9-4140-8d65-39f68d7e7784 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1752 microversion: 2.1 time: 0.169814 Aug 30 02:06:36.767061 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 259/520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:36 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:37.001837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:37.004115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:37.010673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.011160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.012143 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.012850 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.013317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.013789 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.045517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2b1c14ed-64f9-4ca4-9ee0-dfb3f15e0e5a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047461 Aug 30 02:06:37.045851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 262/521] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:06:36 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:06:37.110624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:37.111125 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:37.117240 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.117758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.118196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.118892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.119346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.119767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.145658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Going to try to terminate instance {{(pid=121093) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:06:37.661397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-720ff185-f03e-467c-9161-5b431077f36a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 204 len: 0 microversion: 2.1 time: 0.554275 Aug 30 02:06:37.662053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 260/522] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:06:37 2022] DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:06:37.670966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:37.677589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:37.677837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.678263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.678692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.679370 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.679819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.680237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.788493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:37.789236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:37.796029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.796538 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.796971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.797709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:37.798161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:37.798598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:37.812867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:37.820726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b0eb0f92-2953-4226-9199-19846b44c710 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1675 microversion: 2.1 time: 0.154375 Aug 30 02:06:37.821377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 263/523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:37 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:37.945158 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:37.953377 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2f1666ea-9e82-4140-aaf5-bbcba60dd605 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.169033 Aug 30 02:06:37.953959 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 261/524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:37 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:38.846929 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:38.847538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:38.853945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:38.854423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:38.854854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:38.856294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:38.856748 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:38.857170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:38.974807 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:38.975457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:38.983690 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:38.984180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:38.984610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:38.985331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:38.986029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:38.986445 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:38.994854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:39.003471 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a132e10b-4da5-4ba4-85d6-16132ad2fe93 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1675 microversion: 2.1 time: 0.160575 Aug 30 02:06:39.004055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 264/525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:38 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:39.126927 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:39.135006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8da9f868-6a2c-4fbe-9ee4-2b7384310920 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.164477 Aug 30 02:06:39.135573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 262/526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:38 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:40.024798 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:40.025756 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:40.032866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.033423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.033979 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:40.034729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.035270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.035763 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:40.157030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:40.157751 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:40.164827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.165311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.165774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:40.166472 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.166922 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.167343 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:40.178984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:40.188931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3c146af8-4221-4972-941b-b1dcd67a0847 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1675 microversion: 2.1 time: 0.168053 Aug 30 02:06:40.203229 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 265/527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:40 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:40.382048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:40.390896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4d7bd61d-a654-49a9-9872-ccc54cc8e3f9 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.238637 Aug 30 02:06:40.391551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 263/528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:40 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:40.872596 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-02209bc9-8754-4cdc-abb3-de07e7b8b65a req-940ab12d-f7ec-4d72-82d2-4a3ec14ea32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf23d31-4c2f-4ae6-98c5-bc5ad966309b", "name": "network-vif-deleted", "tag": "0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:40.882513 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-02209bc9-8754-4cdc-abb3-de07e7b8b65a req-940ab12d-f7ec-4d72-82d2-4a3ec14ea32f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:40.883010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-02209bc9-8754-4cdc-abb3-de07e7b8b65a req-940ab12d-f7ec-4d72-82d2-4a3ec14ea32f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:40.884196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-02209bc9-8754-4cdc-abb3-de07e7b8b65a req-940ab12d-f7ec-4d72-82d2-4a3ec14ea32f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:40.895097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-02209bc9-8754-4cdc-abb3-de07e7b8b65a req-940ab12d-f7ec-4d72-82d2-4a3ec14ea32f service nova] Creating event network-vif-deleted:0ee6e6dc-fa7f-40bc-acc6-a27fe6cf9f55 for instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b on hv-cinder-81966 Aug 30 02:06:40.900115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-02209bc9-8754-4cdc-abb3-de07e7b8b65a req-940ab12d-f7ec-4d72-82d2-4a3ec14ea32f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032196 Aug 30 02:06:40.900953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 266/529] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:41.211009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:41.211561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:41.218176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:41.218662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:41.219089 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:41.219783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:41.220256 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:41.220676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:41.285483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:41.294433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f1315606-ac45-4085-99c0-83d4c4093abb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1607 microversion: 2.1 time: 0.087034 Aug 30 02:06:41.294990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 264/530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:41 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1607 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:41.413299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:41.414014 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:41.420790 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:41.421270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:41.421735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:41.422429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:41.422880 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:41.423304 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:41.570299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:41.579359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5e77d70a-988f-49d2-9e75-0a1def5c45e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.170878 Aug 30 02:06:41.579937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 267/531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:41 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:42.316281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:42.316896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:42.323313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:42.323795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:42.324391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:42.325163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:42.325652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:42.326078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:42.386945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:42.394723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-07230165-21f7-47a5-9d56-656714d224ca tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1607 microversion: 2.1 time: 0.082258 Aug 30 02:06:42.395276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 265/532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:42 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1607 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:42.674776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:42.675313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:42.681957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:42.682443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:42.682883 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:42.683629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:42.684087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:42.684515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:42.831140 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:42.839333 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a58975a6-7d2d-48bc-95cb-6ab84c16a91a tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.168505 Aug 30 02:06:42.840715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 268/533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:42 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:43.416152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:43.416776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:43.423687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.424170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.424606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.425300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.425788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.426212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.458018 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.458429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.458872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.459317 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lazy-loading 'fault' on Instance uuid 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:06:43.505573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:43.513817 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1f4a9301-623c-4b1e-9578-bf7f73aba21e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 200 len: 1327 microversion: 2.1 time: 0.101403 Aug 30 02:06:43.514389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 266/534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:43 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:43.861715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:43.872862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:43.872862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.872862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.872862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.873324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:43.873324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:43.873324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:43.956024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1184264002", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "networks": [{"uuid": "2761f1ac-422e-4add-8966-d7328f515b23"}]}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:44.013769 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] validate_networks() for [('2761f1ac-422e-4add-8966-d7328f515b23', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:06:44.029169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:44.037647 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3cff522c-da07-4fa9-b9b5-23bab104e10e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.179784 Aug 30 02:06:44.038239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 269/535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:43 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:44.535736 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:44.536344 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:44.542251 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:44.542943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:44.543171 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:44.543865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:44.544321 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:44.544742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:44.558144 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] HTTP exception thrown: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Request method failure captured: Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b HTTP/1.1 Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-mJgd-hJiEKDb_4_URdFj9vbD250szd6nLcvZeIZlXZJ5HKIBtkKkVN_F1yPT6PJTYPurz50u47qDgQxZWxTpHX6eqXnmYk92FlA4s5ZU14fMvhzNmv3XgfghZ0pU24tZ7yEg1B5liQEvKWy47QGOtI3cYP_wBQtdacIHOOWP9HEg Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:06:44.560019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: bda980735a1f4948ba695e6c2788f3b4 Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:06:44.561266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '0bf23d31-4c2f-4ae6-98c5-bc5ad966309b'} Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:06:44.562036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:06:44.563210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:06:44.564331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Returning 404 to user: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:06:44.564331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6ee8fa38-6272-481b-bc90-dc6f94001807 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 404 len: 111 microversion: 2.1 time: 0.029701 Aug 30 02:06:44.564331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 270/536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:44 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:06:44.570058 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-146eed45-d1c9-47af-b93a-7b94557a0c3c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '.version_select at 0x7f473640a4c0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:44.616693 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:06:44.617157 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:06:44.617637 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:06:44.618050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:06:44.618460 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:06:44.627301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:44.627720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:44.628154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:44.628873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:44.629327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:44.629774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:44.647284 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Getting quotas for project 072e2c259a164ecaa45b5ff18fa3ac66. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:44.651221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Getting quotas for user 789377907cfd4f0f9d3123f6418163f7 and project 072e2c259a164ecaa45b5ff18fa3ac66. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:44.662745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:06:44.665025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:06:44.840122 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-146eed45-d1c9-47af-b93a-7b94557a0c3c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960565659" status: 202 len: 0 microversion: 2.1 time: 0.273349 Aug 30 02:06:44.840730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 271/537] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 02:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960565659 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:06:45.060567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:45.061223 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:45.067873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:45.068357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:45.068792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:45.069502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:45.069962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:45.070388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:45.105895 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-54c31638-a18b-46c6-9455-f6893ba2d04b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153178 Aug 30 02:06:45.106577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 267/538] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:06:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:06:45.119174 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9313bc90-2177-4447-b569-58e1750d1d6a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:45.119785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9313bc90-2177-4447-b569-58e1750d1d6a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:45.173818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9313bc90-2177-4447-b569-58e1750d1d6a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:45.181378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9313bc90-2177-4447-b569-58e1750d1d6a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1219 microversion: 2.1 time: 0.066093 Aug 30 02:06:45.183086 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 268/539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:45 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:45.282508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:45.291199 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3169d8d0-7546-4d5a-acbe-a8373e1e46dc tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.235662 Aug 30 02:06:45.293553 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 272/540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:45 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:45.852113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7cce5db3-fbd3-4229-ac9b-809e36d1acc6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: .version_select at 0x7f473750df70>, body: {"keypair": {"name": "tempest-keypair-1077357142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZdESyW0nEmuNqxV1d1J9vFItZOeE6vhrqxhtULd5/fx09JpfqHaV3Xs9CJx9Cww9w2vtzB4N2DO1Oe72MeSo8Q/XN/PwIKARd1pecFiYMZHyJec31NlqzIFDexEPI/w=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:45.868934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-7cce5db3-fbd3-4229-ac9b-809e36d1acc6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:45.873685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-7cce5db3-fbd3-4229-ac9b-809e36d1acc6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for user bda980735a1f4948ba695e6c2788f3b4 and project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:46.097608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7cce5db3-fbd3-4229-ac9b-809e36d1acc6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249031 Aug 30 02:06:46.098212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 269/541] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:06:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:46.204429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-21297f99-414f-4ebc-81fb-42edf9951a90 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:46.205674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-21297f99-414f-4ebc-81fb-42edf9951a90 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:46.258008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-21297f99-414f-4ebc-81fb-42edf9951a90 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:46.265654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-21297f99-414f-4ebc-81fb-42edf9951a90 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1219 microversion: 2.1 time: 0.065148 Aug 30 02:06:46.266918 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 273/542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:46 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:46.319558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:46.319558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:46.320951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:46.321439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:46.321912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:46.322605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:46.323060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:46.323483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:46.469275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:46.477727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-350ca8cb-adee-4f69-bfb3-5951e788e87e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.167657 Aug 30 02:06:46.478295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 270/543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:46 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:47.287066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:47.287674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:47.295722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:47.296208 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:47.296644 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:47.297341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:47.297824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:47.298247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:47.360326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:47.367867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1f4c5a0d-5bc3-42fa-b3fe-acb086124d27 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1271 microversion: 2.1 time: 0.084672 Aug 30 02:06:47.368425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 274/544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:47 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:47.500135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:47.500980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:47.507531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:47.508009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:47.508436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:47.509123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:47.509604 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:47.510024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:47.681176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:47.690030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a8c56b4a-4940-4b18-8811-13efd71f1652 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.194372 Aug 30 02:06:47.690585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 271/545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:47 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:48.389262 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:48.389987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:48.393509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:48.397001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:48.397514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:48.397954 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:48.398649 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:48.399098 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:48.399577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:48.463951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:48.472688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e9ea4897-623a-45d4-9b26-49bce93e7dbf tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1279 microversion: 2.1 time: 0.087241 Aug 30 02:06:48.473254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 275/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:48 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:48.712337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:48.712846 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:48.725717 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:48.726211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:48.726709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:48.727371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:48.727823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:48.728245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:49.052474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:49.061437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9042dd1e-a714-4e30-ab69-a28fd65b97f8 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.353417 Aug 30 02:06:49.062028 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 272/547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:48 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:49.494556 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:49.495659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:49.503910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:49.505324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:49.505798 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:49.506516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:49.506984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:49.507408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:49.513755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:49.589116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-919919571", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "594c7eaa-27eb-44bb-b03b-2139d7485cc6"}], "security_groups": [{"name": "tempest-securitygroup--553366713"}], "key_name": "tempest-keypair-1077357142", "user_data": "}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:49.649493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:49.659988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7b0dbdc7-89fd-4010-a4a8-b55c98baeb72 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.169580 Aug 30 02:06:49.660574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 276/548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:49 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:49.709964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] validate_networks() for [('594c7eaa-27eb-44bb-b03b-2139d7485cc6', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:06:50.082953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:50.083664 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:50.090820 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.091993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.092354 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.093053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.093580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.094003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.238078 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:50.246803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-72c840aa-a67e-4b1f-b9a6-35a1dff4c650 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.167631 Aug 30 02:06:50.247402 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 277/549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:50 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:50.369329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:06:50.369329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:06:50.369329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:06:50.369329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:06:50.369329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:06:50.373171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.373684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.374121 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.374867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.375329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.375757 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.392601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:06:50.394805 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:50.396906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Getting quotas for user bda980735a1f4948ba695e6c2788f3b4 and project 1cbdcc426c3f4d3090919f1a50e3d626. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:06:50.408318 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:06:50.410493 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:06:50.619644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-df2cd67e-c7c3-49c4-95c7-6d2dd8a345b6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.034614 Aug 30 02:06:50.620491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 273/550] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:06:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:06:50.631681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7eb0f276-995c-4d46-84d2-844ead3c251f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:50.632463 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7eb0f276-995c-4d46-84d2-844ead3c251f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:50.681542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:50.682170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:50.690495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.690761 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.691211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.692267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.692728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.693162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.693858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7eb0f276-995c-4d46-84d2-844ead3c251f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:50.701381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7eb0f276-995c-4d46-84d2-844ead3c251f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1237 microversion: 2.1 time: 0.072976 Aug 30 02:06:50.713991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 278/551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:50 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:50.805306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-116db963-5d88-4e27-ae93-5039ed21a4f1 req-764bf067-c462-4b62-b637-03b373af3c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58916eb-4445-4135-8d17-f4e96a60edb4", "tag": "1b15a408-e3dc-4138-b124-a45209e7f74f"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:50.812706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-116db963-5d88-4e27-ae93-5039ed21a4f1 req-764bf067-c462-4b62-b637-03b373af3c11 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:50.813664 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-116db963-5d88-4e27-ae93-5039ed21a4f1 req-764bf067-c462-4b62-b637-03b373af3c11 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:50.814172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-116db963-5d88-4e27-ae93-5039ed21a4f1 req-764bf067-c462-4b62-b637-03b373af3c11 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:50.825350 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-116db963-5d88-4e27-ae93-5039ed21a4f1 req-764bf067-c462-4b62-b637-03b373af3c11 service nova] Creating event network-changed:1b15a408-e3dc-4138-b124-a45209e7f74f for instance e58916eb-4445-4135-8d17-f4e96a60edb4 on hv-cinder-81966 Aug 30 02:06:50.832604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-116db963-5d88-4e27-ae93-5039ed21a4f1 req-764bf067-c462-4b62-b637-03b373af3c11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Aug 30 02:06:50.833798 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 279/552] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:06:50.928821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:50.938387 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-40fdb066-6a9d-4e76-b8b4-f4dcea488000 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.260671 Aug 30 02:06:50.938963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 274/553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:50 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:51.268917 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:51.270435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:51.276030 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.276514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.276945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.277810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.278306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.278801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.436268 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:51.453139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aaca7ffc-0c7d-4344-99e2-03c86430b1b7 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.188174 Aug 30 02:06:51.453786 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 280/554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:51 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:51.723327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:51.723945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:51.730270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.730776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.731179 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.732470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.732930 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.733354 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.737384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:06:51.838919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:51.847738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f712de25-21f6-422b-8072-3e26d93248d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1241 microversion: 2.1 time: 0.128169 Aug 30 02:06:51.848312 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 275/555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:51 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:51.967142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:51.967729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:51.974441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.974864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.975302 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:51.976148 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:51.976612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:51.977035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.116990 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:52.125529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ce61be90-a23e-4df0-93d8-81375c1138ce tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.162361 Aug 30 02:06:52.126089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 281/556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:51 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:52.475370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:52.476475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:52.485287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.486055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.486699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.487746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.488505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.489153 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.644345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:52.652923 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0a279f08-b293-4772-b937-4fcb5b35694c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.181649 Aug 30 02:06:52.653527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 276/557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:52 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:52.868047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:52.873826 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:52.875839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.876316 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.876745 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.877425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:52.877898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:52.878315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:52.943307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:52.952052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6a51cec4-a711-4faf-a002-9b3ae4ca0f83 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1233 microversion: 2.1 time: 0.087803 Aug 30 02:06:52.952625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 282/558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:52 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:53.146821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:53.147356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:53.154456 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.154929 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.155359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:53.156044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.156495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.156915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:53.295277 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:53.302245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-86a51bb5-c15e-472f-971f-1f5ff3b4255a tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.159653 Aug 30 02:06:53.302824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 277/559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:53 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:53.675568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:53.676106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:53.682612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.683114 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.683658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:53.684631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.685313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.685869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:53.843102 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:53.852492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-cf13856a-f68e-4487-930f-72f4b8f85ceb tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.181066 Aug 30 02:06:53.857398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 283/560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:53 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:53.973825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:53.974586 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:53.983468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.983963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.984427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:53.985149 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:53.985639 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:53.986071 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:54.052598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:54.060890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8f275556-e9d4-4084-af3d-61e89759c0db tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1289 microversion: 2.1 time: 0.091453 Aug 30 02:06:54.061605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 278/561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:53 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:54.323571 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:54.324179 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:54.331446 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:54.331930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:54.332360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:54.333047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:54.333545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:54.333969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:54.476295 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:54.485131 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8bf2448b-7971-403a-a5ba-bb61412eb1ff tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.165469 Aug 30 02:06:54.485739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 284/562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:54 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:54.875554 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:54.876169 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:54.882611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:54.883097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:54.883537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:54.884241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:54.884697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:54.885121 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.085836 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:55.086750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:55.101938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:55.103173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:55.104188 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.109094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:55.110029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:55.110887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.152075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:55.164019 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2b5c7214-22ab-49b7-b380-5848c10367b4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.291170 Aug 30 02:06:55.165351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 279/563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:54 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:55.274490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:55.283379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f397423c-95d1-4313-b86d-d4964c23b1d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.204018 Aug 30 02:06:55.284531 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 285/564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:55 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:55.508306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:55.509430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:55.516614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:55.517250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:55.517875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.518753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:55.519368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:55.520001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:55.726258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:55.735226 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1a419508-33f6-4fb4-a9fd-e89c0cf8064b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.232243 Aug 30 02:06:55.735941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 280/565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:55 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:56.183522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-6e53501e-e646-4765-832f-fa2adb5babf9 req-15029e03-7010-49b8-8bd9-09c2a73c4219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e1a41d-5ba1-4f10-9a70-e87230e90757", "tag": "91d06765-5bf0-4621-b65c-3234580e7137"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:56.187668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:56.188284 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:56.194558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.195040 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.195467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.195778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-6e53501e-e646-4765-832f-fa2adb5babf9 req-15029e03-7010-49b8-8bd9-09c2a73c4219 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.196154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.196370 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-6e53501e-e646-4765-832f-fa2adb5babf9 req-15029e03-7010-49b8-8bd9-09c2a73c4219 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.196598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.197002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-6e53501e-e646-4765-832f-fa2adb5babf9 req-15029e03-7010-49b8-8bd9-09c2a73c4219 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.197220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.210183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-6e53501e-e646-4765-832f-fa2adb5babf9 req-15029e03-7010-49b8-8bd9-09c2a73c4219 service nova] Creating event network-changed:91d06765-5bf0-4621-b65c-3234580e7137 for instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 on hv-cinder-81966 Aug 30 02:06:56.214816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-6e53501e-e646-4765-832f-fa2adb5babf9 req-15029e03-7010-49b8-8bd9-09c2a73c4219 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035769 Aug 30 02:06:56.215722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 286/566] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:56.304652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:56.305347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:56.312225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.312712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.313147 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.313872 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.314329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.314761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.449106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:56.457781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ff9075b2-4f0e-45e9-ad1e-8c3e18606189 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.157169 Aug 30 02:06:56.459586 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:56.470919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5c929deb-e140-4809-8f81-7a57b4def491 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.288323 Aug 30 02:06:56.471623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 281/567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:56 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:56.472958 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 287/568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:56 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:56.757772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:56.761287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:56.767346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.767719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.768220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:56.769176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:56.769704 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:56.770131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:57.004622 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:57.016999 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-dc9c7f7b-2d16-4f22-9e45-51d5dfa354ab tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.263628 Aug 30 02:06:57.023527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 282/569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:56 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:57.138749 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-1bf50dc0-0994-4a2d-92a0-8b344aa9fcdc req-54aa5bd5-d488-4fcb-a6e8-da1c5e05446a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58916eb-4445-4135-8d17-f4e96a60edb4", "name": "network-vif-plugged", "status": "completed", "tag": "1b15a408-e3dc-4138-b124-a45209e7f74f"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:06:57.151472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1bf50dc0-0994-4a2d-92a0-8b344aa9fcdc req-54aa5bd5-d488-4fcb-a6e8-da1c5e05446a service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:57.152018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1bf50dc0-0994-4a2d-92a0-8b344aa9fcdc req-54aa5bd5-d488-4fcb-a6e8-da1c5e05446a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:57.152443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1bf50dc0-0994-4a2d-92a0-8b344aa9fcdc req-54aa5bd5-d488-4fcb-a6e8-da1c5e05446a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:57.164944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-1bf50dc0-0994-4a2d-92a0-8b344aa9fcdc req-54aa5bd5-d488-4fcb-a6e8-da1c5e05446a service nova] Creating event network-vif-plugged:1b15a408-e3dc-4138-b124-a45209e7f74f for instance e58916eb-4445-4135-8d17-f4e96a60edb4 on hv-cinder-81966 Aug 30 02:06:57.170054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-1bf50dc0-0994-4a2d-92a0-8b344aa9fcdc req-54aa5bd5-d488-4fcb-a6e8-da1c5e05446a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Aug 30 02:06:57.176230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 288/570] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:06:57.480547 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:57.481151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:57.487804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:57.488282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:57.488713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:57.489434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:57.489915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:57.490336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:57.496300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:57.497016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:57.503969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:57.504443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:57.504870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:57.505682 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:57.506373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:57.512775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:57.629212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:57.637180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4e0eb9d6-49e1-4064-acab-2f34d9270de0 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.160275 Aug 30 02:06:57.637770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 283/571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:57 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:57.655637 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:57.663755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b4479f69-80f2-4e0b-b368-fd2694d67588 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.172151 Aug 30 02:06:57.664313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 289/572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:57 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:06:58.044810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:58.044810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:58.046117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:58.046593 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:58.047025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:58.047709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:58.048164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:58.048583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:58.328011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:58.335931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9d213ee5-9d38-494b-be8e-a5df33ebb73f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.300626 Aug 30 02:06:58.341784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 284/573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:58 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:58.658303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:58.658914 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:58.665516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:58.666003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:58.666440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:58.667129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:58.667591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:58.668013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:58.686790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:58.687448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:58.694058 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:58.694601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:58.694972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:58.696414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:58.697067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:58.697697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:58.881917 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:58.888968 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:58.891962 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3667a86d-2a44-4603-8689-07ee0ad3417c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.210130 Aug 30 02:06:58.892901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 285/574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:58 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:58.903219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-08143e55-b0f0-4b77-acd7-5818cbf37e8c tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.248873 Aug 30 02:06:58.905000 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 290/575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:58 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:59.357014 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:59.357651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:59.363590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:59.364062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:59.364489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:59.365162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:59.365651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:59.366068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:59.502607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:06:59.510281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1c244084-31a0-4865-b796-ec2120d13b09 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1319 microversion: 2.1 time: 0.157103 Aug 30 02:06:59.510852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 286/576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:59 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:06:59.924980 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:59.926175 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:59.929117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:06:59.929769 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:06:59.933396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:59.933926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:59.944589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:59.944589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:59.944589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:59.944589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:59.944980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:59.944980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:59.944980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:06:59.944980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:06:59.945315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:06:59.945315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:00.073652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:00.081655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-23ea462e-9a2f-4243-b004-32deab955ada tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.160479 Aug 30 02:07:00.090901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 291/577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:59 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:00.097375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:00.105958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-eb756469-fe53-4470-8982-ca056c5a878b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1757 microversion: 2.1 time: 0.181221 Aug 30 02:07:00.106525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 287/578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:06:59 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:00.532279 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:00.532881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:00.538969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:00.539443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:00.539870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:00.540543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:00.540985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:00.541399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:00.670690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:00.678278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-caa16c69-6047-4f8d-9ac0-edcdef9c5a8b tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1508 microversion: 2.1 time: 0.150303 Aug 30 02:07:00.678833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 292/579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:00 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:00.698656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ce6035c-76d0-43fa-bc96-6f7011d6f7d8", "device": "/dev/sdb"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:00.701615 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:00.703686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=4 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:00.704362 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=18 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:00.709189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:00.709766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:00.710143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:00.710847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:00.711300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:00.711758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:01.103440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:01.104029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:01.106186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=4 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:01.121121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:01.121656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:01.122084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:01.123474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:01.123934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:01.124359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:01.255436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:01.263849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6aa303ac-2a7f-47cf-987c-676da09924c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.163728 Aug 30 02:07:01.264548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 293/580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:01 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:01.269065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:01.269700 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:01.275350 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:01.275831 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:01.276268 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:01.276963 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:01.277418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:01.277912 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:01.425671 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:01.434160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-007b8892-9433-493f-b7f8-3ac4ce8a15e6 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1760 microversion: 2.1 time: 0.168640 Aug 30 02:07:01.435226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 294/581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:01 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:01.439731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-1bb820d5-29ab-435d-8b5b-51ccdba86b5c req-5c93559d-f1cf-49b6-a0a4-07e57f2f0488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e1a41d-5ba1-4f10-9a70-e87230e90757", "name": "network-vif-plugged", "status": "completed", "tag": "91d06765-5bf0-4621-b65c-3234580e7137"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:01.448833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1bb820d5-29ab-435d-8b5b-51ccdba86b5c req-5c93559d-f1cf-49b6-a0a4-07e57f2f0488 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:01.449311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1bb820d5-29ab-435d-8b5b-51ccdba86b5c req-5c93559d-f1cf-49b6-a0a4-07e57f2f0488 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:01.449763 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-1bb820d5-29ab-435d-8b5b-51ccdba86b5c req-5c93559d-f1cf-49b6-a0a4-07e57f2f0488 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:01.461577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-1bb820d5-29ab-435d-8b5b-51ccdba86b5c req-5c93559d-f1cf-49b6-a0a4-07e57f2f0488 service nova] Creating event network-vif-plugged:91d06765-5bf0-4621-b65c-3234580e7137 for instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 on hv-cinder-81966 Aug 30 02:07:01.466519 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-1bb820d5-29ab-435d-8b5b-51ccdba86b5c req-5c93559d-f1cf-49b6-a0a4-07e57f2f0488 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030089 Aug 30 02:07:01.467073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 295/582] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:01.940250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5cb09c58-e41b-411f-a1a6-a7832d649277 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "POST /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.245347 Aug 30 02:07:01.940856 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 288/583] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:07:00 2022] POST /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4/os-volume_attachments => generated 194 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:02.287139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:02.287831 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:02.293980 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:02.295284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:02.295720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:02.296403 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:02.296853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:02.297276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:02.315731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:02.428333 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:02.436765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c0417dab-2084-482c-98a9-7d3d71e46105 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.154319 Aug 30 02:07:02.437326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 296/584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:02 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:03.457170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:03.457908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:03.464055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:03.464535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:03.464973 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:03.465719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:03.466676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:03.467098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:03.601027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:03.609382 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e144cfcb-5ffb-47ce-8f66-67f770d1b750 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1362 microversion: 2.1 time: 0.156804 Aug 30 02:07:03.610011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 289/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:03 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:04.477991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:04.478511 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:04.485404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.485914 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.486342 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.487022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.487473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.487889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.566910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'services' on Instance uuid 0ecaa0bb-82d5-4a54-b0de-3f755d373450 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:04.629710 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:04.630326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:04.636864 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.637353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.637880 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.638574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.639025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.639448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.655305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:04.771025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:04.778658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e79e8137-a410-4218-a30b-ce84a5466e34 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1548 microversion: 2.1 time: 0.152673 Aug 30 02:07:04.779214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 290/586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:04 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:04.798706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:04.802505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:04.805028 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.805438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.806003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.806572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.807021 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.808057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.881923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a7db15ec-6632-4748-96e5-5ef7e6371996 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments/d3c3504e-3bfd-473f-bcfc-4279f0035fe7" status: 202 len: 0 microversion: 2.1 time: 0.407696 Aug 30 02:07:04.882663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 297/587] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:04 2022] DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments/d3c3504e-3bfd-473f-bcfc-4279f0035fe7 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:04.883887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-187e9ac7-c431-4dea-985d-47f0106f89d8 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088619 Aug 30 02:07:04.884569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 291/588] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:07:04 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:04.891574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:04.893945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:04.900427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.901083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.901542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.902477 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:04.903035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:04.903354 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:04.937487 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3417db6f-3fe7-4905-807d-06a3d480e35f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050310 Aug 30 02:07:04.939892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 298/589] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:04 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:05.951229 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:05.953857 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:05.960780 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:05.961267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:05.961727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:05.962463 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:05.962916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:05.963336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:05.996311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9998bd93-b989-4b56-8653-b2ac983d6379 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050112 Aug 30 02:07:05.996885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 292/590] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:05 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:06.154950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-b7d00bd0-c442-4c3f-9190-ee0d608731a4 req-d6c35d09-1062-4b05-b075-495b271b6736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e1a41d-5ba1-4f10-9a70-e87230e90757", "tag": "91d06765-5bf0-4621-b65c-3234580e7137"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:06.164922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-b7d00bd0-c442-4c3f-9190-ee0d608731a4 req-d6c35d09-1062-4b05-b075-495b271b6736 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:06.165397 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-b7d00bd0-c442-4c3f-9190-ee0d608731a4 req-d6c35d09-1062-4b05-b075-495b271b6736 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:06.165852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-b7d00bd0-c442-4c3f-9190-ee0d608731a4 req-d6c35d09-1062-4b05-b075-495b271b6736 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:06.177743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-b7d00bd0-c442-4c3f-9190-ee0d608731a4 req-d6c35d09-1062-4b05-b075-495b271b6736 service nova] Creating event network-changed:91d06765-5bf0-4621-b65c-3234580e7137 for instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 on hv-cinder-81966 Aug 30 02:07:06.183006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-b7d00bd0-c442-4c3f-9190-ee0d608731a4 req-d6c35d09-1062-4b05-b075-495b271b6736 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031744 Aug 30 02:07:06.183924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 299/591] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:07.010614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:07.012474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:07.020694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:07.021322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:07.021823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:07.022516 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:07.022975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:07.023397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:07.054811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0c17ca5d-4b32-40bd-8fcb-4297f9901196 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Aug 30 02:07:07.055380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 293/592] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:07 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:08.067877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:08.070138 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:08.076765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:08.077241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:08.077707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:08.078409 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:08.078866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:08.079290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:08.111250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d8b9a67e-a0f3-466b-b2e1-a5c01da90bc7 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047683 Aug 30 02:07:08.111807 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 300/593] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:08 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:09.124359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:09.126516 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:09.132953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:09.133428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:09.133904 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:09.134597 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:09.135051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:09.135472 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:09.164296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-31b8e762-652c-456b-aa89-58c158c4ed89 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Aug 30 02:07:09.164844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 294/594] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:09 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:10.176624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:10.178759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:10.186155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:10.186645 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:10.187090 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:10.187791 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:10.188250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:10.188681 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:10.219839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f6d9299a-3c51-4d0f-8a8a-4d80e7056ed6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047240 Aug 30 02:07:10.220400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 301/595] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:10 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:11.233652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:11.235712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:11.242441 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.243011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.243519 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.244200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.244653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.245069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.276122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e57623de-61b5-4472-be49-ee7c5e86e17e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047581 Aug 30 02:07:11.276693 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 295/596] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:11 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:11.282554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:11.283166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:11.289884 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.290368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.290796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.291485 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:11.291930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:11.292345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:11.316212 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d857f374-098c-4662-821e-8aa8b3f2ad1c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/ips" status: 200 len: 151 microversion: 2.1 time: 0.038578 Aug 30 02:07:11.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 302/597] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:07:11 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:12.341848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:12.344137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:12.350333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.350819 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.351259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.351951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.352408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.352835 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.381753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d6889fe4-045a-43a8-ae06-fd6deba97168 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097225 Aug 30 02:07:12.382300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 296/598] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:12 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:07:12.467084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:12.467634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:12.474122 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.474605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.475049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.475734 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.476190 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.476611 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.501754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:12.834813 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-42faf31e-4d2e-45c0-9f40-2ebec7f09f95 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 204 len: 0 microversion: 2.1 time: 0.371638 Aug 30 02:07:12.835425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 303/599] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:12 2022] DELETE /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:12.843455 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:12.844066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:12.850368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.850850 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.851289 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.851983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:12.852438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:12.852862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:12.991551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:12.999929 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-306032ba-d25b-4fbe-a410-8fd444f636cd tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.160360 Aug 30 02:07:13.000487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 297/600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:12 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:14.022945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:14.023642 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:14.030067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:14.032085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:14.032085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:14.032085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:14.032085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:14.032556 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:14.165967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:14.173874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-25ab8fbd-f46d-4ff1-969e-dd8749cbe3cf tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.154952 Aug 30 02:07:14.174440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 304/601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:14 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:15.152267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29a7537f-132f-4d45-80d7-32d0546d3491"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:15.156259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:15.163327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:15.163934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:15.164373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:15.165079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:15.165575 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:15.165985 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:15.195510 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:15.196289 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:15.201247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:07:15.201496 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Tue Aug 30 02:07:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 (ip 10.222.0.27) !!! Aug 30 02:07:15.206213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:15.206724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:15.207236 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:15.207819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:15.208277 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:15.208704 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:15.340097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:15.348754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-206303c4-da9f-43e0-a8b3-dbe233cdf307 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.156874 Aug 30 02:07:15.349322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 305/602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:15 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:16.369129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:16.369927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:16.376215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:16.376688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:16.377117 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:16.377828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:16.378276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:16.378693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:16.505077 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:16.512670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a6f200cd-fa46-46ba-8d54-4963c30343ae tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.147447 Aug 30 02:07:16.513234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 306/603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:16 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:17.534356 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:17.535019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:17.541422 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:17.541931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:17.542365 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:17.543051 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:17.543507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:17.543932 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:17.676824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:17.684436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3ded7269-eef6-435f-9f78-a6f818b3c955 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.154003 Aug 30 02:07:17.684986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 307/604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:17 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:18.706936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:18.707595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:18.714015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:18.714499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:18.714933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:18.715655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:18.716112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:18.716539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:18.843973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:18.851909 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fde1eac2-8d95-4318-ab75-f40d30985301 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.148806 Aug 30 02:07:18.852478 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 308/605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:18 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:19.816886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3659f324-999e-4b8e-b054-fc32cbb503af tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.668377 Aug 30 02:07:19.818492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 298/606] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:07:15 2022] POST /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments => generated 194 bytes in 4671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:19.876697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:19.876697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:19.895078 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:19.895794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:19.897286 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:19.898037 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:19.898513 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:19.898919 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:20.274524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:20.282741 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dd7d0f2d-cb41-4396-b92c-a5140928160c tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1691 microversion: 2.1 time: 0.413494 Aug 30 02:07:20.283304 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 309/607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:19 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1691 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:20.678003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-e8d2e61b-1865-4bcb-8a9d-055f9f8c1907 req-0682e022-9d65-4a84-b7bd-481f77050602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ecaa0bb-82d5-4a54-b0de-3f755d373450", "name": "network-vif-deleted", "tag": "0613d132-cca5-44d5-80b4-de90c29f8aa0"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:20.689113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-e8d2e61b-1865-4bcb-8a9d-055f9f8c1907 req-0682e022-9d65-4a84-b7bd-481f77050602 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:20.692232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-e8d2e61b-1865-4bcb-8a9d-055f9f8c1907 req-0682e022-9d65-4a84-b7bd-481f77050602 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:20.692232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-e8d2e61b-1865-4bcb-8a9d-055f9f8c1907 req-0682e022-9d65-4a84-b7bd-481f77050602 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:20.705944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-e8d2e61b-1865-4bcb-8a9d-055f9f8c1907 req-0682e022-9d65-4a84-b7bd-481f77050602 service nova] Creating event network-vif-deleted:0613d132-cca5-44d5-80b4-de90c29f8aa0 for instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 on hv-cinder-81966 Aug 30 02:07:20.712067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-e8d2e61b-1865-4bcb-8a9d-055f9f8c1907 req-0682e022-9d65-4a84-b7bd-481f77050602 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038534 Aug 30 02:07:20.713034 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 299/608] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:21.305852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:21.307214 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:21.315024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:21.317068 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:21.317665 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:21.318176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:21.319023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:21.319561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:21.320046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:21.356029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:21.356582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:21.357107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:21.357652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'fault' on Instance uuid 0ecaa0bb-82d5-4a54-b0de-3f755d373450 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:21.401315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:21.413601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ed62d0f8-f6c0-442a-84b0-95c0db2a5cc0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 200 len: 1336 microversion: 2.1 time: 0.112458 Aug 30 02:07:21.415014 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 310/609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:21 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:22.437091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:22.438380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 0ecaa0bb-82d5-4a54-b0de-3f755d373450] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:22.440284 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:22.445090 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:22.445608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:22.446040 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:22.446721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:22.447162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:22.447582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:22.462168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] HTTP exception thrown: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 could not be found. Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Request method failure captured: Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 HTTP/1.1 Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-j5eMVFWWxeoVc-5Z-GuOXySHRUTux_Ukrnsj75kKbnJP8Al-Cju828nksPBw5nVT3zt1edet8GIOseWj_iM2trtgt0mC0Zo-bKO9lbTjd6b_jB8uDYJIv7BAeYURGbNtdLfie_tdt4XUtDp41_2FmJvOAbTBOcLjiPOcQLrC0NHM Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:07:22.463766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 5e7584fe83684b01baa31ab67edac026 Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 could not be found. Aug 30 02:07:22.465517 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '0ecaa0bb-82d5-4a54-b0de-3f755d373450'} Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 could not be found. Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:22.466340 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 could not be found. Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 could not be found. Aug 30 02:07:22.467793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:22.469075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Returning 404 to user: Instance 0ecaa0bb-82d5-4a54-b0de-3f755d373450 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:22.469075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ddb07097-a168-4334-aace-d4a5319460a9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450" status: 404 len: 111 microversion: 2.1 time: 0.032793 Aug 30 02:07:22.469075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 300/610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:22 2022] GET /compute/v2.1/servers/0ecaa0bb-82d5-4a54-b0de-3f755d373450 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:22.475201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dba09d12-7127-4971-8296-7f8b87d21ccb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '.version_select at 0x7f47362594c0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:22.583107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dba09d12-7127-4971-8296-7f8b87d21ccb tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232171576" status: 202 len: 0 microversion: 2.1 time: 0.112394 Aug 30 02:07:22.583612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 311/611] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 02:07:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232171576 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:23.539828 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:23.540341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:23.548033 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:23.548507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:23.548936 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:23.549652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:23.550101 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:23.550520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:23.632059 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lazy-loading 'services' on Instance uuid e58916eb-4445-4135-8d17-f4e96a60edb4 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:24.006000 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ff1d318a-16c4-4441-8c7c-2c2cb6fbdcc6 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4/os-volume_attachments/2ce6035c-76d0-43fa-bc96-6f7011d6f7d8" status: 202 len: 0 microversion: 2.1 time: 0.469866 Aug 30 02:07:24.006581 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 301/612] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:23 2022] DELETE /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4/os-volume_attachments/2ce6035c-76d0-43fa-bc96-6f7011d6f7d8 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:26.027342 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:26.027873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:26.033869 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:26.035047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:26.035524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:26.036204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:26.036656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:26.037073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:26.056191 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:26.063219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:26.467602 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5bab0826-2963-4399-b2ac-932373e7c981 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 204 len: 0 microversion: 2.1 time: 0.444832 Aug 30 02:07:26.468312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 312/613] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:26 2022] DELETE /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:26.477939 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:26.478615 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:26.484653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:26.485130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:26.485585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:26.486270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:26.486718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:26.487135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:26.617359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:26.625022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-93351946-5eda-4c7c-81ca-b27a19216f16 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1507 microversion: 2.1 time: 0.152398 Aug 30 02:07:26.648199 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 302/614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:26 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:27.647437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:27.648242 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:27.654692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:27.655238 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:27.655601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:27.656297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:27.656757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:27.657201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:27.791198 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:27.798738 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-14b1ff4c-4aad-4d05-88a0-02b675767e52 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1507 microversion: 2.1 time: 0.155690 Aug 30 02:07:27.799296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 313/615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:27 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:28.820316 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:28.820928 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:28.827350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:28.827834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:28.828270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:28.828962 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:28.829418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:28.829870 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:28.959504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:28.967172 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fff9f8ae-116e-42d9-ab5d-ed4f5743dfb6 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1507 microversion: 2.1 time: 0.150828 Aug 30 02:07:28.967740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 303/616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:28 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:29.974195 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-61a60280-cd31-4a7e-bfad-72d6375cad89 req-b2d0b479-940b-48b3-ab27-36a7b7aaf225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cecad39-31d7-4dc6-a7b7-9c759be0732c", "name": "network-vif-deleted", "tag": "4fe22a1d-4332-4831-ab82-7f45c452f699"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:29.984697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-61a60280-cd31-4a7e-bfad-72d6375cad89 req-b2d0b479-940b-48b3-ab27-36a7b7aaf225 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:29.985413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-61a60280-cd31-4a7e-bfad-72d6375cad89 req-b2d0b479-940b-48b3-ab27-36a7b7aaf225 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:29.986066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-61a60280-cd31-4a7e-bfad-72d6375cad89 req-b2d0b479-940b-48b3-ab27-36a7b7aaf225 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:29.988625 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:29.989595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:29.999287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-61a60280-cd31-4a7e-bfad-72d6375cad89 req-b2d0b479-940b-48b3-ab27-36a7b7aaf225 service nova] Creating event network-vif-deleted:4fe22a1d-4332-4831-ab82-7f45c452f699 for instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c on hv-cinder-81966 Aug 30 02:07:30.004908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-61a60280-cd31-4a7e-bfad-72d6375cad89 req-b2d0b479-940b-48b3-ab27-36a7b7aaf225 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Aug 30 02:07:30.006394 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 314/617] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:30.026275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:30.026769 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:30.027206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:30.027920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:30.028379 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:30.028808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:30.111892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:30.123361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6919b673-01aa-425d-9270-930d1aac27a2 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1465 microversion: 2.1 time: 0.138912 Aug 30 02:07:30.123886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 304/618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:29 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:30.558438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29a7537f-132f-4d45-80d7-32d0546d3491"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:30.560860 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:30.566967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:30.567454 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:30.567889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:30.569469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:30.570014 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:30.570435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:30.655952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Invalid volume: volume 29a7537f-132f-4d45-80d7-32d0546d3491 is already attached to instances: 5e085f77-4bea-423b-afcd-a2c59f5210db Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: POST /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments HTTP/1.1 Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 74 Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:07:30.660377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {"volumeAttachment": {"volumeId": "29a7537f-132f-4d45-80d7-32d0546d3491"}} Aug 30 02:07:30.662060 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Invalid volume: volume 29a7537f-132f-4d45-80d7-32d0546d3491 is already attached to instances: 5e085f77-4bea-423b-afcd-a2c59f5210db Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'server_id': '5e085f77-4bea-423b-afcd-a2c59f5210db', 'body': {'volumeAttachment': {'volumeId': '29a7537f-132f-4d45-80d7-32d0546d3491'}}} Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 29a7537f-132f-4d45-80d7-32d0546d3491 is already attached to instances: 5e085f77-4bea-423b-afcd-a2c59f5210db Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:30.663089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 29a7537f-132f-4d45-80d7-32d0546d3491 is already attached to instances: 5e085f77-4bea-423b-afcd-a2c59f5210db Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:30.664427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 29a7537f-132f-4d45-80d7-32d0546d3491 is already attached to instances: 5e085f77-4bea-423b-afcd-a2c59f5210db Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 400 to user: Invalid volume: volume 29a7537f-132f-4d45-80d7-32d0546d3491 is already attached to instances: 5e085f77-4bea-423b-afcd-a2c59f5210db {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b58c0e3b-da32-4129-8eaf-700ee0a429b3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105502 Aug 30 02:07:30.666669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 315/619] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:07:30 2022] POST /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:07:30.730265 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:30.730756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:30.736606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:30.740673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:30.740673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:30.740673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:30.740673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:30.741044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:30.821692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'services' on Instance uuid 5e085f77-4bea-423b-afcd-a2c59f5210db {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:31.069172 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c69b937c-1f8f-4418-a76d-7f5012bce98f tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments/29a7537f-132f-4d45-80d7-32d0546d3491" status: 202 len: 0 microversion: 2.1 time: 0.341807 Aug 30 02:07:31.069883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 305/620] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:30 2022] DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments/29a7537f-132f-4d45-80d7-32d0546d3491 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:31.078334 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:31.080542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:31.088127 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.088607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.089038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.089800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.090263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.090686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.121509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-64c311c8-a7df-4a50-a8ca-29d4f2459342 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Aug 30 02:07:31.122112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 316/621] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:31 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:31.145486 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:31.146204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:31.152347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.152918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.153348 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.154069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.154520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.154937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.157533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:31.190005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.190489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.191012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.191512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'fault' on Instance uuid 5cecad39-31d7-4dc6-a7b7-9c759be0732c {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:31.235140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:31.244183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-92588736-4751-4df3-9717-37a17e3d031d tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 200 len: 1311 microversion: 2.1 time: 0.103422 Aug 30 02:07:31.245646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 306/622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:31 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:31.479032 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:31.479520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:31.485830 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.486249 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.486674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.487348 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.487792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.488204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.513033 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:31.884717 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-78c33169-d6bf-42ef-b4bb-f9ac34ce3a79 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 204 len: 0 microversion: 2.1 time: 0.409786 Aug 30 02:07:31.885338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 317/623] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:31 2022] DELETE /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:31.893333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:31.893941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:31.901422 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.901984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.909947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:31.909947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:31.909947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:31.909947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.033551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:32.043287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ba6112dc-9219-4b96-af29-2caf6fd27b73 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1514 microversion: 2.1 time: 0.153587 Aug 30 02:07:32.043856 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 307/624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:31 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:32.135522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:32.138148 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:32.144455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.144938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.145375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.146128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.146589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.147058 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.177639 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5b750b95-aeec-4b09-919f-ce44b4d061f8 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047389 Aug 30 02:07:32.178201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 318/625] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:32 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:32.267651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:32.268251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: 5cecad39-31d7-4dc6-a7b7-9c759be0732c] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:32.275016 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.275491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.280508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.280508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.280508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.280508 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.291288 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] HTTP exception thrown: Instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c could not be found. Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Request method failure captured: Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c HTTP/1.1 Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-j5eMVFWWxeoVc-5Z-GuOXySHRUTux_Ukrnsj75kKbnJP8Al-Cju828nksPBw5nVT3zt1edet8GIOseWj_iM2trtgt0mC0Zo-bKO9lbTjd6b_jB8uDYJIv7BAeYURGbNtdLfie_tdt4XUtDp41_2FmJvOAbTBOcLjiPOcQLrC0NHM Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:07:32.292894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 5e7584fe83684b01baa31ab67edac026 Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c could not be found. Aug 30 02:07:32.294375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '5cecad39-31d7-4dc6-a7b7-9c759be0732c'} Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c could not be found. Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:32.295225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c could not be found. Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c could not be found. Aug 30 02:07:32.296589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:32.297964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Returning 404 to user: Instance 5cecad39-31d7-4dc6-a7b7-9c759be0732c could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:32.297964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-edde69a7-6a1d-440d-a3f7-80802e36a760 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c" status: 404 len: 111 microversion: 2.1 time: 0.030621 Aug 30 02:07:32.297964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 308/626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:32 2022] GET /compute/v2.1/servers/5cecad39-31d7-4dc6-a7b7-9c759be0732c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:32.302851 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:32.303404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:32.309506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.309991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.310423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.311109 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.311563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.311986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.337559 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:32.714928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-58782f54-fb9a-45aa-a36d-28effb898d39 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 204 len: 0 microversion: 2.1 time: 0.415637 Aug 30 02:07:32.715506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 319/627] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:32 2022] DELETE /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:32.723428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:32.724335 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:32.730823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.731304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.731739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.738845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:32.738845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:32.738845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:32.865687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:32.873908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-68aa9e11-7c66-4a1b-ae7e-cd4834804a2f tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.154304 Aug 30 02:07:32.874465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 309/628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:32 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:33.064631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:33.065347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:33.071588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:33.072098 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:33.072528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:33.073208 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:33.073690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:33.074102 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:33.190008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:33.192237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:33.198782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:33.199262 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:33.199700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:33.200395 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:33.200843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:33.201259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:33.206406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:33.214758 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bc8da6a4-d59b-4a03-ab82-609e06061226 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1514 microversion: 2.1 time: 0.154332 Aug 30 02:07:33.215321 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 320/629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:33 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:33.233641 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-71e919cd-71bd-432a-9526-22a4450eadbf tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047640 Aug 30 02:07:33.234200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 310/630] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:33 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:33.894366 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:33.894973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:33.901937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:33.902415 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:33.902846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:33.903529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:33.903983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:33.904397 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.036982 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:34.045528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-08cdcb0a-f03d-4913-95d6-c15b1175acb0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.155006 Aug 30 02:07:34.046088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 321/631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:33 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:34.236138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:34.236706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:34.243389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.243869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.244302 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.244991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.245444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.245633 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:34.246041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.247985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:34.254493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.254965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.255393 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.256081 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.256529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.257635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.287344 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-14474480-f58b-4e0d-afa1-3b1799e37237 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045666 Aug 30 02:07:34.287906 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 322/632] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:34 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 02:07:34.350159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:34.351655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:34.357640 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.358127 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.358561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.359248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.359697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.360115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.375842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:34.384160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-49abfd30-091f-49b2-bb77-59b050d26448 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1514 microversion: 2.1 time: 0.151917 Aug 30 02:07:34.384731 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 311/633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:34 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:34.385658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:34.419315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:34.749525 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-719f3860-e5bf-4c53-82c1-e50f5c4354df tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 204 len: 0 microversion: 2.1 time: 0.403111 Aug 30 02:07:34.750112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 323/634] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:34 2022] DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:07:34.758973 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:34.759605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:34.765561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.766038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.766462 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.767176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:34.767762 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:34.768171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:34.899927 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:34.907610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-08147170-00b6-4ea4-b96b-3df5e745cfeb tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1684 microversion: 2.1 time: 0.153091 Aug 30 02:07:34.908173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 312/635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:34 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:35.067173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:35.067863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:35.074055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.074543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.074976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.075672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.076124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.076547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.208786 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:35.218411 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7726d002-bc09-4055-add0-c5538e9cc8e5 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.155499 Aug 30 02:07:35.218972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 324/636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:35 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:35.404697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:35.405206 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:35.411748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.412218 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.412645 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.413957 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.414415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.414831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.543520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:35.551150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ec978100-d506-4fcc-a11a-57edda35611f tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1514 microversion: 2.1 time: 0.150506 Aug 30 02:07:35.551924 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 313/637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:35 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:35.936402 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:35.936402 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:35.970038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.970038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.970038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:35.970038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:35.970412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:35.970412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.074504 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:36.082458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a6f70645-787b-4eb9-9f9c-0ee448cb44de tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1684 microversion: 2.1 time: 0.156718 Aug 30 02:07:36.083016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 325/638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:35 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:36.239850 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:36.240372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:36.246577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.247053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.247484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.248166 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.248617 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.249035 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.375980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:36.383572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ed1f57a4-2b35-4829-8317-15fb933ea3af tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.147705 Aug 30 02:07:36.384130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 314/639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:36 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:36.572639 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:36.573243 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:36.579272 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.579746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.580183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.580862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:36.581308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:36.581750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:36.714733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:36.723073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-432aa0a9-963c-43d0-8e4f-af76900bad21 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1514 microversion: 2.1 time: 0.154436 Aug 30 02:07:36.723247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 326/640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:36 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:37.104361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:37.104970 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:37.111734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.112220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.112654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.113611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.114075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.114500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.247701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:37.255463 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-34d6c9ad-8180-4a7b-9f3f-a7bceb12cc73 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1684 microversion: 2.1 time: 0.155055 Aug 30 02:07:37.269980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 315/641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:37 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:37.400824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-f7fba07c-7989-4547-acd8-e6b3fb520243 req-5dd4b4ff-2d1e-47c8-8961-7c26f4c3010e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58916eb-4445-4135-8d17-f4e96a60edb4", "name": "network-vif-deleted", "tag": "1b15a408-e3dc-4138-b124-a45209e7f74f"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:37.404703 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:37.405319 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:37.410570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-f7fba07c-7989-4547-acd8-e6b3fb520243 req-5dd4b4ff-2d1e-47c8-8961-7c26f4c3010e service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.411049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-f7fba07c-7989-4547-acd8-e6b3fb520243 req-5dd4b4ff-2d1e-47c8-8961-7c26f4c3010e service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.411420 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.411542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-f7fba07c-7989-4547-acd8-e6b3fb520243 req-5dd4b4ff-2d1e-47c8-8961-7c26f4c3010e service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.411909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.412356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.413048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.413569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.413992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.424661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-f7fba07c-7989-4547-acd8-e6b3fb520243 req-5dd4b4ff-2d1e-47c8-8961-7c26f4c3010e service nova] Creating event network-vif-deleted:1b15a408-e3dc-4138-b124-a45209e7f74f for instance e58916eb-4445-4135-8d17-f4e96a60edb4 on hv-cinder-81966 Aug 30 02:07:37.429752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-f7fba07c-7989-4547-acd8-e6b3fb520243 req-5dd4b4ff-2d1e-47c8-8961-7c26f4c3010e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090079 Aug 30 02:07:37.430315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 327/642] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:37.544963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:37.552607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-49388a17-f5fe-4516-bc6c-c05701900406 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.151832 Aug 30 02:07:37.553171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 316/643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:37 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:37.745755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:37.746461 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:37.752542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.753023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.753546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.754172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:37.754629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:37.755053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:37.816536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:37.824931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ce1f2a0b-4c5a-48ea-ac09-31c8d7c5e869 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1472 microversion: 2.1 time: 0.084433 Aug 30 02:07:37.825516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 328/644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:37 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:38.277864 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:38.278403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:38.284951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.285432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.285896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.286591 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.287047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.287468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.419019 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:38.426896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5a4f07a9-2851-40c2-8582-e071ab988ec4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1684 microversion: 2.1 time: 0.153028 Aug 30 02:07:38.427539 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 317/645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:38 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:38.574289 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:38.575173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:38.581810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.582299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.582736 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.583471 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.583927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.584349 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.724395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:38.725608 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-00fcf182-6ea4-467f-a617-8e3dab3b16f9 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1522 microversion: 2.1 time: 0.155698 Aug 30 02:07:38.734139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 329/646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:38 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:38.846396 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:38.847454 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:38.855054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.855535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.855960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.856652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.857096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.857720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.889912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:38.890645 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:38.891080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:38.891525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lazy-loading 'fault' on Instance uuid e58916eb-4445-4135-8d17-f4e96a60edb4 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:38.965758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789377907cfd4f0f9d3123f6418163f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072e2c259a164ecaa45b5ff18fa3ac66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:38.973394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-39556292-c68f-4911-9581-1debd0019c23 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 200 len: 1309 microversion: 2.1 time: 0.131483 Aug 30 02:07:38.985513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 318/647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:38 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:39.445007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-e6ca6933-8cbb-4020-9f06-79f4aa99eb8b req-7bb32139-49da-4692-a266-6a4afed6caba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a817aa2c-97a9-4aa6-bb24-95caeb130e67", "name": "network-vif-deleted", "tag": "61565fda-094d-4fe4-931b-8cf82b3d145d"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:39.448935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:39.449603 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:39.455691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-e6ca6933-8cbb-4020-9f06-79f4aa99eb8b req-7bb32139-49da-4692-a266-6a4afed6caba service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.461053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-e6ca6933-8cbb-4020-9f06-79f4aa99eb8b req-7bb32139-49da-4692-a266-6a4afed6caba service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.461203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.461203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.461402 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-e6ca6933-8cbb-4020-9f06-79f4aa99eb8b req-7bb32139-49da-4692-a266-6a4afed6caba service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.461624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.461624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.461624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.461624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.470267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-e6ca6933-8cbb-4020-9f06-79f4aa99eb8b req-7bb32139-49da-4692-a266-6a4afed6caba service nova] Creating event network-vif-deleted:61565fda-094d-4fe4-931b-8cf82b3d145d for instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 on hv-cinder-81966 Aug 30 02:07:39.476532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-e6ca6933-8cbb-4020-9f06-79f4aa99eb8b req-7bb32139-49da-4692-a266-6a4afed6caba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034933 Aug 30 02:07:39.477837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 330/648] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:39.562675 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:39.575042 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9a2c463a-90ff-432c-b5f8-b5d2fad88f5d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1616 microversion: 2.1 time: 0.130826 Aug 30 02:07:39.581801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 319/649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:39 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1616 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:39.756365 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:39.757598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:39.764570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.765055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.765504 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.766207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.766659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.767107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.801259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:39.801776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:39.802211 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:39.802654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lazy-loading 'fault' on Instance uuid a817aa2c-97a9-4aa6-bb24-95caeb130e67 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:39.847059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e7584fe83684b01baa31ab67edac026', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f4b9bbe0b640688754d04484900cca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:39.855713 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2c240716-421b-41ed-9af6-1231c554a76e tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 200 len: 1312 microversion: 2.1 time: 0.103561 Aug 30 02:07:39.856266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 331/650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:39 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:39.996465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:39.997078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] [instance: e58916eb-4445-4135-8d17-f4e96a60edb4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:40.004995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.005522 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.005970 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.006677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.008220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.008928 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.035683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] HTTP exception thrown: Instance e58916eb-4445-4135-8d17-f4e96a60edb4 could not be found. Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Request method failure captured: Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 HTTP/1.1 Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXBSELAsNyHkxffHO4bpWHeVDs_REJV5FJ22Ay57-5sWWdmO5ZXbx21lrjuylBYsOIHUj_ovXj6qax5E5pifPE5SD7FESuNPDTuQ50yisBxRDS7aXG-8QdodHQEhcdPdUEv-CgVaifWaOBITIdmYDhSyF1o6wXNlo7Jv_bUk7d5g4Pg Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: 072e2c259a164ecaa45b5ff18fa3ac66 Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1794144427 Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:07:40.037632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072e2c259a164ecaa45b5ff18fa3ac66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-VolumesSnapshotTestJSON-1794144427 Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: 072e2c259a164ecaa45b5ff18fa3ac66 Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1794144427 Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-VolumesSnapshotTestJSON-1794144427-project Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 789377907cfd4f0f9d3123f6418163f7 Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-VolumesSnapshotTestJSON-1794144427-project Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance e58916eb-4445-4135-8d17-f4e96a60edb4 could not be found. Aug 30 02:07:40.039231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'e58916eb-4445-4135-8d17-f4e96a60edb4'} Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58916eb-4445-4135-8d17-f4e96a60edb4 could not be found. Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:40.040143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58916eb-4445-4135-8d17-f4e96a60edb4 could not be found. Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58916eb-4445-4135-8d17-f4e96a60edb4 could not be found. Aug 30 02:07:40.042141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.044003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] Returning 404 to user: Instance e58916eb-4445-4135-8d17-f4e96a60edb4 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:40.044003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bd56ed0c-5681-49cb-818d-266b5ae3a679 tempest-VolumesSnapshotTestJSON-1794144427 tempest-VolumesSnapshotTestJSON-1794144427-project] 10.222.0.27 "GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4" status: 404 len: 111 microversion: 2.1 time: 0.047865 Aug 30 02:07:40.044003 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 320/651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:39 2022] GET /compute/v2.1/servers/e58916eb-4445-4135-8d17-f4e96a60edb4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:40.597564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:40.598168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:40.604797 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.605279 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.605740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.606440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.606893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.607325 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.692108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:40.701959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4e92feb2-a592-4211-b8b9-ee75438f10ce tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 200 len: 1327 microversion: 2.1 time: 0.108101 Aug 30 02:07:40.702829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 332/652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:40 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:40.879315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:40.880061 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] [instance: a817aa2c-97a9-4aa6-bb24-95caeb130e67] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:40.888011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.888655 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.889365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.890423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:40.890836 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:40.891330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:40.907997 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] HTTP exception thrown: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 could not be found. Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Request method failure captured: Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 HTTP/1.1 Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-j5eMVFWWxeoVc-5Z-GuOXySHRUTux_Ukrnsj75kKbnJP8Al-Cju828nksPBw5nVT3zt1edet8GIOseWj_iM2trtgt0mC0Zo-bKO9lbTjd6b_jB8uDYJIv7BAeYURGbNtdLfie_tdt4XUtDp41_2FmJvOAbTBOcLjiPOcQLrC0NHM Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:07:40.909658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7f4b9bbe0b640688754d04484900cca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: e7f4b9bbe0b640688754d04484900cca Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-496230511 Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 5e7584fe83684b01baa31ab67edac026 Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-ServerRescueNegativeTestJSON-496230511-project Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 could not be found. Aug 30 02:07:40.911249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'a817aa2c-97a9-4aa6-bb24-95caeb130e67'} Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 could not be found. Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:40.912178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 could not be found. Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 could not be found. Aug 30 02:07:40.913935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:40.925748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] Returning 404 to user: Instance a817aa2c-97a9-4aa6-bb24-95caeb130e67 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:40.925748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-85f27f82-0446-4c70-af68-a65213b3bed0 tempest-ServerRescueNegativeTestJSON-496230511 tempest-ServerRescueNegativeTestJSON-496230511-project] 10.222.0.27 "GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67" status: 404 len: 111 microversion: 2.1 time: 0.037129 Aug 30 02:07:40.925748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 321/653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:40 2022] GET /compute/v2.1/servers/a817aa2c-97a9-4aa6-bb24-95caeb130e67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:41.497019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-50844b4a-9b26-438f-a226-7ada3ede2e80 req-7d5ad2be-0306-4ee0-ad53-dce2ba12b151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e085f77-4bea-423b-afcd-a2c59f5210db", "name": "network-vif-deleted", "tag": "74d417e1-55c5-4a16-8d11-a5c6fa5048b0"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:41.504458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-50844b4a-9b26-438f-a226-7ada3ede2e80 req-7d5ad2be-0306-4ee0-ad53-dce2ba12b151 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:41.504939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-50844b4a-9b26-438f-a226-7ada3ede2e80 req-7d5ad2be-0306-4ee0-ad53-dce2ba12b151 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:41.505367 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-50844b4a-9b26-438f-a226-7ada3ede2e80 req-7d5ad2be-0306-4ee0-ad53-dce2ba12b151 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:41.517437 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-50844b4a-9b26-438f-a226-7ada3ede2e80 req-7d5ad2be-0306-4ee0-ad53-dce2ba12b151 service nova] Creating event network-vif-deleted:74d417e1-55c5-4a16-8d11-a5c6fa5048b0 for instance 5e085f77-4bea-423b-afcd-a2c59f5210db on hv-cinder-81966 Aug 30 02:07:41.522364 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-50844b4a-9b26-438f-a226-7ada3ede2e80 req-7d5ad2be-0306-4ee0-ad53-dce2ba12b151 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032079 Aug 30 02:07:41.523358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 333/654] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:41.726383 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:41.727022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:41.732867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:41.733345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:41.733840 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:41.734727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:41.735242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:41.735660 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:41.759022 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db HTTP/1.1 Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:07:41.760839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:07:41.762376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '5e085f77-4bea-423b-afcd-a2c59f5210db'} Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:41.763334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:07:41.764725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:07:41.767629 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:41.768842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-37947e0e-7f7f-4cfa-9986-931ad554be89 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 404 len: 111 microversion: 2.1 time: 0.046756 Aug 30 02:07:41.769948 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 322/655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:41 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:41.780709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-37fd53ce-d747-4338-ad41-8381d2a76e1e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '.version_select at 0x7f4736271f70>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:41.922738 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-37fd53ce-d747-4338-ad41-8381d2a76e1e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958612000" status: 202 len: 0 microversion: 2.1 time: 0.148108 Aug 30 02:07:41.923324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 334/656] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 02:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958612000 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:07:42.752281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f97270ab-7079-49a6-8749-686aff7ee3f4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: .version_select at 0x7f4736508f70>, body: {"keypair": {"name": "tempest-keypair-1708838247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKzFpEgO3noAfBylB8LIcuMv9RmEx3NQMRb7etVSsEIqOZnEWtVwo1iTDHTITzS4zKQog0ZShDVFTZegkJ0vbypFqn+K+dt0ZhOh4Q0d41/J+8qLBX0CYQz6KA1KqHBMQ=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:42.769068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-f97270ab-7079-49a6-8749-686aff7ee3f4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:07:42.773666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-f97270ab-7079-49a6-8749-686aff7ee3f4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:07:42.877025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f97270ab-7079-49a6-8749-686aff7ee3f4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128548 Aug 30 02:07:42.877748 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 323/657] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:07:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:45.419876 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1585186633"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:45.420384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-110492795", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316431ff-b22a-409c-830b-a78363ccfbd0"}], "security_groups": [{"name": "tempest-securitygroup--1888782476"}], "key_name": "tempest-keypair-1708838247", "user_data": "}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:45.420837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:45.427978 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:45.429560 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:45.430167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:45.431083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:45.431878 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:45.432336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:45.546253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] validate_networks() for [('316431ff-b22a-409c-830b-a78363ccfbd0', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:07:45.592241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.network.security_group_api [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Removing security group 0585ab8a-3d60-4195-b9b6-d3a8fb293e30 from port d458433e-132c-4f16-ab95-b7d676233c95 Aug 30 02:07:46.033593 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-88ed679b-8b1b-42dd-ac68-10caa9345885 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/action" status: 202 len: 0 microversion: 2.1 time: 0.617583 Aug 30 02:07:46.037836 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 335/658] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:07:45 2022] POST /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:46.164876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:07:46.166931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:07:46.166931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:07:46.166931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:07:46.167371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:07:46.180591 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:46.181224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:46.181870 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:46.183147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:46.183919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:46.184769 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:46.218267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:07:46.232292 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Getting quotas for user 7af1c1123b2e458b84248865287bd00e and project c57bc7a319f14bf393e6249b2cb59c69. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:07:46.246553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:07:46.249174 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:07:46.307093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-15b06b69-ff4b-4cb3-961e-a1e31970fad9 req-ff216842-8aac-45a5-866f-08c9e4f300a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:46.317387 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-15b06b69-ff4b-4cb3-961e-a1e31970fad9 req-ff216842-8aac-45a5-866f-08c9e4f300a3 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:46.319533 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-15b06b69-ff4b-4cb3-961e-a1e31970fad9 req-ff216842-8aac-45a5-866f-08c9e4f300a3 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:46.319533 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-15b06b69-ff4b-4cb3-961e-a1e31970fad9 req-ff216842-8aac-45a5-866f-08c9e4f300a3 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:46.330492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-15b06b69-ff4b-4cb3-961e-a1e31970fad9 req-ff216842-8aac-45a5-866f-08c9e4f300a3 service nova] Creating event network-changed:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:07:46.336286 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-15b06b69-ff4b-4cb3-961e-a1e31970fad9 req-ff216842-8aac-45a5-866f-08c9e4f300a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292709 Aug 30 02:07:46.337092 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 336/659] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:46.401861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ae945b62-c970-4217-8386-be37bc795632 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.985837 Aug 30 02:07:46.403266 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 324/660] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:07:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:07:46.419566 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-620fef78-6ea6-4444-9810-df57654dbd72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:46.421041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-620fef78-6ea6-4444-9810-df57654dbd72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:46.517814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-620fef78-6ea6-4444-9810-df57654dbd72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:46.527042 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-620fef78-6ea6-4444-9810-df57654dbd72 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1241 microversion: 2.1 time: 0.116113 Aug 30 02:07:46.528202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 337/661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:46 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:47.550491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:47.551116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:47.561975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:47.562475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:47.562914 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:47.563879 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:47.564339 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:47.564765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:47.729964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:47.751578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ce17b726-b729-4359-8cec-c64f78bb85ac tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1245 microversion: 2.1 time: 0.203485 Aug 30 02:07:47.752367 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 325/662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:47 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1245 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:48.161657 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:48.162200 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:48.168447 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-36c8d46f-cd21-48c3-aa7b-023e296fc279 req-29be3302-eda3-4ad1-83b0-57d898c0d46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:48.170176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.174160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.174160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.174160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.174160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.174500 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.181287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-36c8d46f-cd21-48c3-aa7b-023e296fc279 req-29be3302-eda3-4ad1-83b0-57d898c0d46b service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.182333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-36c8d46f-cd21-48c3-aa7b-023e296fc279 req-29be3302-eda3-4ad1-83b0-57d898c0d46b service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.182863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-36c8d46f-cd21-48c3-aa7b-023e296fc279 req-29be3302-eda3-4ad1-83b0-57d898c0d46b service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.195057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-36c8d46f-cd21-48c3-aa7b-023e296fc279 req-29be3302-eda3-4ad1-83b0-57d898c0d46b service nova] Creating event network-changed:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:07:48.200929 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-36c8d46f-cd21-48c3-aa7b-023e296fc279 req-29be3302-eda3-4ad1-83b0-57d898c0d46b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043545 Aug 30 02:07:48.201847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 326/663] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:48.364323 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lazy-loading 'services' on Instance uuid cc2fa0e2-0911-4087-989a-4897b5545c24 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:07:48.664186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2c3760c0-2593-4b59-8803-b7647568a77e tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments/eb635ab3-4124-497e-952d-fadae476dbdb" status: 202 len: 0 microversion: 2.1 time: 0.508461 Aug 30 02:07:48.664857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 338/664] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:48 2022] DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments/eb635ab3-4124-497e-952d-fadae476dbdb => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:07:48.674301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:48.676827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:48.689610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.689610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.689610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.689610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.689993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.689993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.700830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:48.736858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-17dd8784-1ee2-4bdc-b704-9bc4a06bb889 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067458 Aug 30 02:07:48.737424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 327/665] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:48 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:48.775567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:48.776354 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:48.782604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.783086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.783543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.784256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:48.784708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:48.785125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:48.872428 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:48.885536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fe153f85-00f9-4552-b62d-3e7f4f520853 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1293 microversion: 2.1 time: 0.114521 Aug 30 02:07:48.886164 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 339/666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:48 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:49.749615 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:49.751847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:49.759939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:49.760590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:49.761266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:49.762211 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:49.763359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:49.764013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:49.854315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a34fca39-0978-4648-ac4f-470e7ee3d764 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108601 Aug 30 02:07:49.855648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 340/667] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:49 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:49.909284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:49.919021 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:49.920754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:49.922434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:49.923040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:49.924716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:49.925822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:49.926452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:50.038957 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:50.045756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:50.055124 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:50.056356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:50.059023 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:50.061105 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:50.065932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:50.066503 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:50.095945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-74e30612-cc07-4ddb-bc34-a24c192c3203 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/ips" status: 200 len: 146 microversion: 2.1 time: 0.406083 Aug 30 02:07:50.103632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 328/668] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:07:49 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/ips => generated 146 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:50.137985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:50.146217 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d2768a20-cf05-4c1b-8c6b-c3ed912434b5 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1311 microversion: 2.1 time: 0.240303 Aug 30 02:07:50.151709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 341/669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:49 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:50.868421 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:50.870750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:50.889047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:50.889642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:50.890082 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:50.890800 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:50.891240 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:50.891657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:50.955451 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8a9f51ce-0c5d-4e0d-8361-06ba8000b51c tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092276 Aug 30 02:07:50.956099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 329/670] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:07:50 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:07:50.966766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:50.968035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:50.975312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:50.976702 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:50.977324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:50.978326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:50.979002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:50.979657 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:51.096276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] HTTP exception thrown: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 is not attached to volume eb635ab3-4124-497e-952d-fadae476dbdb Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Request method failure captured: Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments/eb635ab3-4124-497e-952d-fadae476dbdb HTTP/1.1 Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXA8V95yT1rTQ-wXlJJbfwpF28-PTP2XtPB1noAIPAazWE4ZaYZ--curoSi1sKfX8Qi9yZZz8CV61g56hz8YwZNmUBci1Yvmv1o62plg4zDKCo2dUQ1odD4MqFRykGu1SJSjQoEX-apeYHKDuVj6lh-CaMNoO_yExj4CurCuALWyURg Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: b6200be9acd14756908c3fd33adf1506 Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-TestMinimumBasicScenario-10324548 Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:07:51.098817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6200be9acd14756908c3fd33adf1506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6200be9acd14756908c3fd33adf1506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6200be9acd14756908c3fd33adf1506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6200be9acd14756908c3fd33adf1506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-TestMinimumBasicScenario-10324548 Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: b6200be9acd14756908c3fd33adf1506 Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-TestMinimumBasicScenario-10324548 Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-TestMinimumBasicScenario-10324548-project Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 95c7f09cc2ba4dddae564bbe99ea8a7d Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-TestMinimumBasicScenario-10324548-project Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:07:51.108814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 is not attached to volume eb635ab3-4124-497e-952d-fadae476dbdb Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'server_id': 'cc2fa0e2-0911-4087-989a-4897b5545c24', 'id': 'eb635ab3-4124-497e-952d-fadae476dbdb'} Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eb635ab3-4124-497e-952d-fadae476dbdb. Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:07:51.109714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 is not attached to volume eb635ab3-4124-497e-952d-fadae476dbdb Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 is not attached to volume eb635ab3-4124-497e-952d-fadae476dbdb Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:07:51.110926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Returning 404 to user: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 is not attached to volume eb635ab3-4124-497e-952d-fadae476dbdb {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:07:51.112061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d97d81c5-752a-4cba-989a-fc4934af3cc1 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments/eb635ab3-4124-497e-952d-fadae476dbdb" status: 404 len: 154 microversion: 2.1 time: 0.140286 Aug 30 02:07:51.112061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 342/671] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:07:50 2022] DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24/os-volume_attachments/eb635ab3-4124-497e-952d-fadae476dbdb => generated 154 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:07:51.168296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:51.169660 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:51.183299 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:51.184550 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:51.184992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:51.185738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:51.186438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:51.187053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:51.454772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:51.468887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1ec53f3f-a4e5-40f4-a7e2-de7cbc1e085d tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.304764 Aug 30 02:07:51.489158 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 330/672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:51 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:52.213705 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-7ee85681-9e4e-4b02-b57d-6ee3506ce108 req-e6778831-6d61-4b01-9d3b-6a9bf6480569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425acb15-9950-46c5-a2ed-b50c6a63c623", "tag": "4ec91ba2-bb53-4e38-acb6-5ef19b92eb86"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:52.220921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a70e598-2a1b-4594-8806-30682c3b7bfd"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:52.224473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:52.226080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=4 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:52.228391 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7ee85681-9e4e-4b02-b57d-6ee3506ce108 req-e6778831-6d61-4b01-9d3b-6a9bf6480569 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:52.228999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7ee85681-9e4e-4b02-b57d-6ee3506ce108 req-e6778831-6d61-4b01-9d3b-6a9bf6480569 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:52.229821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7ee85681-9e4e-4b02-b57d-6ee3506ce108 req-e6778831-6d61-4b01-9d3b-6a9bf6480569 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:52.242449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:52.243070 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:52.247085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:52.247085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:52.247085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:52.248720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-7ee85681-9e4e-4b02-b57d-6ee3506ce108 req-e6778831-6d61-4b01-9d3b-6a9bf6480569 service nova] Creating event network-changed:4ec91ba2-bb53-4e38-acb6-5ef19b92eb86 for instance 425acb15-9950-46c5-a2ed-b50c6a63c623 on hv-cinder-81966 Aug 30 02:07:52.250391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:52.256805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-7ee85681-9e4e-4b02-b57d-6ee3506ce108 req-e6778831-6d61-4b01-9d3b-6a9bf6480569 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048421 Aug 30 02:07:52.259032 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 343/673] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:07:52.500922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:52.503382 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:52.517201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:52.518010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:52.518671 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:52.519605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:52.520353 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:52.520962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:52.551837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:53.017796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:53.026189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fc111cbb-b790-4144-bf3a-7c1304f6a4a1 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.532146 Aug 30 02:07:53.027247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 344/674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:52 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:53.044528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:53.045401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:53.051429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:53.052531 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:53.052976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:53.053758 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:53.054782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:53.055442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:53.081783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:07:53.925388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e853f08d-47ce-493c-9a77-04e7aedbb26f tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 204 len: 0 microversion: 2.1 time: 0.896617 Aug 30 02:07:53.926012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 345/675] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:07:53 2022] DELETE /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:07:53.936156 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:53.936856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:53.943326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:53.943948 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:53.945049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:53.946310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:53.946937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:53.947467 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:54.020930 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-48431f03-dcdb-4166-8e88-9cb52cbd8a92 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.805231 Aug 30 02:07:54.027622 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 331/676] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:07:52 2022] POST /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments => generated 194 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:54.048343 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:54.049259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:54.051736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:54.056573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:54.056982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:54.057636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:54.058511 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:54.059130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:54.059721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:54.192205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:54.201787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1c7a649e-36d0-4a08-880a-5797619b68a2 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1554 microversion: 2.1 time: 0.270852 Aug 30 02:07:54.214361 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 346/677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:53 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1554 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:54.228286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:54.236674 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5044fc1c-35b4-4e5c-9670-9fa9f6d5646b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.192435 Aug 30 02:07:54.239140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 332/678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:54 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:54.987916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9a770f95-f22d-499d-ae95-a853b98fe1f5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'create', calling method: .version_select at 0x7f47362653a0>, body: {"keypair": {"name": "tempest-keypair-1029931658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmuV7HUe3/TE7o3FaXzxvnSpSnr48KwlXtTJ12S4Y8kOlZvBLI4n7pNxXi6jruiH0wFwxfqcJAZ4zy52sJVei+cwSjRYsNi0z7ez8LfQhSwnz0Oiw+xGxU/drlFY25Ajg=="}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:55.003456 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-9a770f95-f22d-499d-ae95-a853b98fe1f5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for project abe39137b275484ea6dafbed8d826eb3. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:07:55.007339 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-9a770f95-f22d-499d-ae95-a853b98fe1f5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for user 3eb33b1b787447daa68b651f9686574a and project abe39137b275484ea6dafbed8d826eb3. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:07:55.172310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9a770f95-f22d-499d-ae95-a853b98fe1f5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.239839 Aug 30 02:07:55.173169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 347/679] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 02:07:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 241 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 02:07:55.224163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:55.225112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:55.232002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:55.232832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:55.233432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:55.234257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:55.234782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:55.235269 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:55.258819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:55.259572 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:55.268193 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:55.268952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:55.269388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:55.270240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:55.270854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:55.271278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:55.371717 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:55.379708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2125b060-feac-4012-9e90-57bbfa4d2cb4 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1554 microversion: 2.1 time: 0.159402 Aug 30 02:07:55.380360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 333/680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:55 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:55.446216 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:55.454169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0000d93b-4404-4a4a-a394-48c1e8f04e8c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.200084 Aug 30 02:07:55.454741 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 348/681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:55 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:56.404686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:56.405663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:56.413530 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:56.414946 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=10 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:07:56.417535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:56.418136 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:56.418791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:56.419556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:56.420062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:56.420537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:56.476514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:56.477240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:56.484938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:56.485423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:56.485889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:56.486594 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:56.487131 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:56.487554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:56.592825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:56.614478 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c009c564-93dc-4891-9f2c-3911c87cc55b tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1554 microversion: 2.1 time: 0.215853 Aug 30 02:07:56.626317 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 334/682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:56 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:56.693691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:56.703312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-349c0b5a-4335-4182-af9c-c9080eb02aa4 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.232359 Aug 30 02:07:56.703899 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 349/683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:56 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:57.637770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:57.638415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:57.645946 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:57.646457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:57.646883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:57.648783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:57.649354 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:57.649802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:57.726517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:57.727142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:57.753880 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:57.756121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:57.757952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:57.764313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:57.765054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:57.765653 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:57.879193 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:57.893326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5e6604f4-f008-458b-be35-af33b36e1068 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1554 microversion: 2.1 time: 0.259945 Aug 30 02:07:57.893954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 335/684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:57 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1554 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:57.998367 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:58.006302 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a6657bb3-c5b6-4a0b-943c-cdafe4c65a2a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.284283 Aug 30 02:07:58.007472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 350/685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:57 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:58.314371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-101685177", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb8beefb-67a8-4456-8962-31eb3e214427"}], "security_groups": [{"name": "tempest-securitygroup--1611521111"}], "key_name": "tempest-keypair-1029931658", "user_data": "}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:58.478109 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] validate_networks() for [('cb8beefb-67a8-4456-8962-31eb3e214427', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:07:58.915473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:58.916294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:58.925067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:58.925677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:58.926126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:58.927169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:58.927629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:58.928052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.126696 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:59.135422 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9db3de67-967e-4777-b4c3-b18d30cead05 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1554 microversion: 2.1 time: 0.224027 Aug 30 02:07:59.135993 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 351/686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:58 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:07:59.152871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:59.157368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:59.174314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:07:59.175484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:07:59.176442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:07:59.177976 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:07:59.178409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:07:59.178579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.179541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.179971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.180839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.181337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.181753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.199936 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.200582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.201272 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.202042 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.202497 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.202921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.220812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for project abe39137b275484ea6dafbed8d826eb3. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:07:59.226667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for user 3eb33b1b787447daa68b651f9686574a and project abe39137b275484ea6dafbed8d826eb3. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:07:59.239347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:07:59.242552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:07:59.331774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:59.340018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b3034061-a12f-4c48-aba4-2a585734a772 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.199906 Aug 30 02:07:59.345288 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 352/687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:07:59 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:07:59.385645 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-27511620-de3c-4340-9976-4475f243eaf7 req-7d9a10ad-103b-4ace-9309-dfcf5bed7430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2fa0e2-0911-4087-989a-4897b5545c24", "name": "network-vif-deleted", "tag": "d458433e-132c-4f16-ab95-b7d676233c95"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:07:59.418170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-290a44b9-3503-4017-9496-d04daa1ad33e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.098270 Aug 30 02:07:59.418170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 336/688] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 02:07:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 30 02:07:59.418695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-27511620-de3c-4340-9976-4475f243eaf7 req-7d9a10ad-103b-4ace-9309-dfcf5bed7430 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:07:59.418695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-27511620-de3c-4340-9976-4475f243eaf7 req-7d9a10ad-103b-4ace-9309-dfcf5bed7430 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:07:59.418695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-27511620-de3c-4340-9976-4475f243eaf7 req-7d9a10ad-103b-4ace-9309-dfcf5bed7430 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:07:59.424437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-21b6655c-40b8-4b06-b578-9f9eb61a0e42 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:07:59.424994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-21b6655c-40b8-4b06-b578-9f9eb61a0e42 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:07:59.477290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-27511620-de3c-4340-9976-4475f243eaf7 req-7d9a10ad-103b-4ace-9309-dfcf5bed7430 service nova] Creating event network-vif-deleted:d458433e-132c-4f16-ab95-b7d676233c95 for instance cc2fa0e2-0911-4087-989a-4897b5545c24 on hv-cinder-81966 Aug 30 02:07:59.494536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-27511620-de3c-4340-9976-4475f243eaf7 req-7d9a10ad-103b-4ace-9309-dfcf5bed7430 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116370 Aug 30 02:07:59.495417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 353/689] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:07:59.508852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-21b6655c-40b8-4b06-b578-9f9eb61a0e42 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:59.521608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-21b6655c-40b8-4b06-b578-9f9eb61a0e42 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:59.523401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-21b6655c-40b8-4b06-b578-9f9eb61a0e42 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:07:59.540749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-21b6655c-40b8-4b06-b578-9f9eb61a0e42 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1281 microversion: 2.20 time: 0.106136 Aug 30 02:07:59.540749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 337/690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:07:59 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1281 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:00.158656 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:00.159360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:00.167244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.167907 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.168352 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.169097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.169588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.170018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.205325 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.205834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.206277 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.206729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lazy-loading 'fault' on Instance uuid cc2fa0e2-0911-4087-989a-4897b5545c24 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:00.251820 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95c7f09cc2ba4dddae564bbe99ea8a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6200be9acd14756908c3fd33adf1506', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:00.260231 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aa8ab425-bc88-4b88-9493-6a1a03cb3829 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 200 len: 1347 microversion: 2.1 time: 0.107524 Aug 30 02:08:00.260797 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 354/691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:00 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 1347 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:00.367654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:00.368258 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:00.375972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.376499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.376971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.377700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.380456 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.380456 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.522907 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:00.534807 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-337526d6-d19a-4ae4-8d49-4634bdefce21 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.171024 Aug 30 02:08:00.535545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 338/692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:00 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:00.556377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-91aeefc8-11fe-4907-9cd9-eb4953bd5b57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:00.557288 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-91aeefc8-11fe-4907-9cd9-eb4953bd5b57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:00.626718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-91aeefc8-11fe-4907-9cd9-eb4953bd5b57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:00.635778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-91aeefc8-11fe-4907-9cd9-eb4953bd5b57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:00.646697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-91aeefc8-11fe-4907-9cd9-eb4953bd5b57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:00.646697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-91aeefc8-11fe-4907-9cd9-eb4953bd5b57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1281 microversion: 2.20 time: 0.087745 Aug 30 02:08:00.646697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 355/693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:00 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:00.693169 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-099b5b77-e4f5-407b-894c-e3bb009787b9 req-02348ff2-7679-4b03-beb7-fde2fb6eccaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425acb15-9950-46c5-a2ed-b50c6a63c623", "name": "network-vif-plugged", "status": "completed", "tag": "4ec91ba2-bb53-4e38-acb6-5ef19b92eb86"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:00.708466 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-099b5b77-e4f5-407b-894c-e3bb009787b9 req-02348ff2-7679-4b03-beb7-fde2fb6eccaf service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:00.708952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-099b5b77-e4f5-407b-894c-e3bb009787b9 req-02348ff2-7679-4b03-beb7-fde2fb6eccaf service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:00.710795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-099b5b77-e4f5-407b-894c-e3bb009787b9 req-02348ff2-7679-4b03-beb7-fde2fb6eccaf service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:00.734005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-099b5b77-e4f5-407b-894c-e3bb009787b9 req-02348ff2-7679-4b03-beb7-fde2fb6eccaf service nova] Creating event network-vif-plugged:4ec91ba2-bb53-4e38-acb6-5ef19b92eb86 for instance 425acb15-9950-46c5-a2ed-b50c6a63c623 on hv-cinder-81966 Aug 30 02:08:00.735657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-099b5b77-e4f5-407b-894c-e3bb009787b9 req-02348ff2-7679-4b03-beb7-fde2fb6eccaf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105016 Aug 30 02:08:00.735778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 339/694] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:01.284130 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:01.284906 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] [instance: cc2fa0e2-0911-4087-989a-4897b5545c24] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:01.292247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.292724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.293157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.293904 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.294357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.294775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.308059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] HTTP exception thrown: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 could not be found. Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Request method failure captured: Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 HTTP/1.1 Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXA8V95yT1rTQ-wXlJJbfwpF28-PTP2XtPB1noAIPAazWE4ZaYZ--curoSi1sKfX8Qi9yZZz8CV61g56hz8YwZNmUBci1Yvmv1o62plg4zDKCo2dUQ1odD4MqFRykGu1SJSjQoEX-apeYHKDuVj6lh-CaMNoO_yExj4CurCuALWyURg Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: b6200be9acd14756908c3fd33adf1506 Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-TestMinimumBasicScenario-10324548 Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:01.316902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6200be9acd14756908c3fd33adf1506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6200be9acd14756908c3fd33adf1506"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6200be9acd14756908c3fd33adf1506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6200be9acd14756908c3fd33adf1506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-TestMinimumBasicScenario-10324548 Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: b6200be9acd14756908c3fd33adf1506 Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-TestMinimumBasicScenario-10324548 Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-TestMinimumBasicScenario-10324548-project Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 95c7f09cc2ba4dddae564bbe99ea8a7d Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-TestMinimumBasicScenario-10324548-project Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 could not be found. Aug 30 02:08:01.318627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'cc2fa0e2-0911-4087-989a-4897b5545c24'} Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 could not be found. Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:01.320155 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 could not be found. Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 could not be found. Aug 30 02:08:01.321802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:01.323187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Returning 404 to user: Instance cc2fa0e2-0911-4087-989a-4897b5545c24 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:01.323187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-319a6064-47ba-480b-a04a-117af83204a5 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24" status: 404 len: 111 microversion: 2.1 time: 0.030865 Aug 30 02:08:01.323187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 356/695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:01 2022] GET /compute/v2.1/servers/cc2fa0e2-0911-4087-989a-4897b5545c24 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:01.323431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-41b85c0e-a727-40f0-b6cc-183638728359 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] Calling method '.version_select at 0x7f473645f550>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:01.464925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-41b85c0e-a727-40f0-b6cc-183638728359 tempest-TestMinimumBasicScenario-10324548 tempest-TestMinimumBasicScenario-10324548-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-683002779" status: 202 len: 0 microversion: 2.1 time: 0.148622 Aug 30 02:08:01.465577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 340/696] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 02:08:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-683002779 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:01.561966 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:01.563075 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:01.569787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.570593 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.571008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.571712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.572166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.572597 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.662602 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:01.663878 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:01.676734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.677315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.678445 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.680025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:01.680690 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:01.681314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:01.731224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:01.739420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-52714d27-74b8-43ff-9332-d2581174a384 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1367 microversion: 2.1 time: 0.181468 Aug 30 02:08:01.739986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 357/697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:01 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:01.770577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:01.787006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:01.788897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:01.790053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-648602db-044a-454a-a370-7ae68a282559 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1285 microversion: 2.20 time: 0.131608 Aug 30 02:08:01.790605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 341/698] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:01 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:02.760977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:02.761617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:02.767909 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.768380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.768841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:02.769554 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.770007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.770565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:02.812808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:02.813427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:02.819956 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.820443 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.820881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:02.821616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.822074 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.822680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:02.919754 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:02.927213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:02.928322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:02.930575 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:02.931912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-38787477-ce26-4400-81d4-2afb4df7db9f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1333 microversion: 2.20 time: 0.122875 Aug 30 02:08:02.932465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 342/699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:02 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:02.943496 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-86d73b69-be96-4aad-8f61-0c8c55a265be tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1558 microversion: 2.1 time: 0.180423 Aug 30 02:08:02.943496 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 358/700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:02 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:02.957442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:02.957892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:02.964099 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.964580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.965015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:02.965774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:02.966230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:02.966661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:03.044272 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-61b941bd-f400-4bf7-a82c-c34bcedaf51c tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090715 Aug 30 02:08:03.044913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 359/701] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 02:08:02 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:03.958769 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:03.959523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:03.967730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:03.968449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:03.970068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:03.970799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:03.971568 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:03.972001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:04.193213 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:04.200180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:04.201920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:04.203409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-be57fc7a-e926-43d5-bee8-bef114d41e15 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.249101 Aug 30 02:08:04.204442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 343/702] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:03 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:04.977887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-7d2524ae-fa25-4225-a511-d85249aa81bd req-8cd2b7bb-287c-4d16-a264-d6e8dbfd51ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425acb15-9950-46c5-a2ed-b50c6a63c623", "tag": "4ec91ba2-bb53-4e38-acb6-5ef19b92eb86"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:04.998844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7d2524ae-fa25-4225-a511-d85249aa81bd req-8cd2b7bb-287c-4d16-a264-d6e8dbfd51ff service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:04.999328 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7d2524ae-fa25-4225-a511-d85249aa81bd req-8cd2b7bb-287c-4d16-a264-d6e8dbfd51ff service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:05.006046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7d2524ae-fa25-4225-a511-d85249aa81bd req-8cd2b7bb-287c-4d16-a264-d6e8dbfd51ff service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:05.016479 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-7d2524ae-fa25-4225-a511-d85249aa81bd req-8cd2b7bb-287c-4d16-a264-d6e8dbfd51ff service nova] Creating event network-changed:4ec91ba2-bb53-4e38-acb6-5ef19b92eb86 for instance 425acb15-9950-46c5-a2ed-b50c6a63c623 on hv-cinder-81966 Aug 30 02:08:05.021984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-7d2524ae-fa25-4225-a511-d85249aa81bd req-8cd2b7bb-287c-4d16-a264-d6e8dbfd51ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055738 Aug 30 02:08:05.023441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 360/703] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:05.236057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:05.240390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:05.251791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:05.254122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:05.255795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:05.258681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:05.265727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:05.266317 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:05.596480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:05.615043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:05.619642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:05.621666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ac069d24-3124-4d56-af64-60879f04c394 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.390103 Aug 30 02:08:05.638487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 344/704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:05 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:05.932311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-2511c28e-7ee8-469e-8350-cf4104fc187e req-0748ffad-86a8-43fa-8a10-f6151a43a298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:05.976399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-2511c28e-7ee8-469e-8350-cf4104fc187e req-0748ffad-86a8-43fa-8a10-f6151a43a298 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:05.980295 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-2511c28e-7ee8-469e-8350-cf4104fc187e req-0748ffad-86a8-43fa-8a10-f6151a43a298 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:05.981417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-2511c28e-7ee8-469e-8350-cf4104fc187e req-0748ffad-86a8-43fa-8a10-f6151a43a298 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.020928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-2511c28e-7ee8-469e-8350-cf4104fc187e req-0748ffad-86a8-43fa-8a10-f6151a43a298 service nova] Creating event network-changed:fe64b060-7adc-4085-b29b-f081c84456b4 for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 on hv-cinder-81966 Aug 30 02:08:06.035108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-2511c28e-7ee8-469e-8350-cf4104fc187e req-0748ffad-86a8-43fa-8a10-f6151a43a298 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107847 Aug 30 02:08:06.047265 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 361/705] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:06.123143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:06.125801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:06.133900 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.134686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.138148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.138148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.138148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.138148 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.211253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cfb25f38-a11f-48b6-a14c-e5672f266a2d tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092896 Aug 30 02:08:06.211867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 345/706] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:06 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:06.227839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:06.228909 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:06.237628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.238268 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.238846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.239829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.240357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.240855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.290691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4397f5db-c608-4eff-8a33-03dd4a12ea52 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/5a70e598-2a1b-4594-8806-30682c3b7bfd" status: 200 len: 194 microversion: 2.1 time: 0.068700 Aug 30 02:08:06.291860 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 362/707] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 30 02:08:06 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/5a70e598-2a1b-4594-8806-30682c3b7bfd => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:06.645241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:06.645980 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:06.666324 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.666811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.668883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.671375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:06.671854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:06.672283 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:06.680918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:06.841866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:06.850578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:06.852284 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:06.853576 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-42ddadfb-7c2e-4a0a-b0af-f66f197cf7a3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.212603 Aug 30 02:08:06.854147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 346/708] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:06 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:07.879376 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:07.890801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:07.894767 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:07.895533 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:07.896152 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:07.897132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:07.901293 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:07.901861 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:08.067298 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:08.076129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:08.078576 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:08.079191 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1664edfa-f6ed-40c1-9070-d1b5c05bc277 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.204735 Aug 30 02:08:08.079744 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 363/709] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:07 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:08.235248 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0979e4bb-16b0-41f5-ab79-1fe294c11c02"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:08.237424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:08.246400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:08.246982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:08.247484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:08.248354 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:08.248871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:08.249365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:09.103858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:09.105310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:09.112284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:09.112881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:09.113358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:09.114136 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:09.114901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:09.115528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:09.120676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:09.210881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:09.274292 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-34a7de17-7b0c-43cb-ab00-e101a8852aeb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "POST /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044245 Aug 30 02:08:09.275716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 347/710] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:08:08 2022] POST /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:09.513112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:09.524921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:09.526393 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:09.527512 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6c5df764-a2e6-4d2e-aa1e-947cc53d9f0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.429039 Aug 30 02:08:09.541730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 364/711] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:09 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:10.549671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=8 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:10.556183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:10.557274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:10.565228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:10.565979 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:10.566631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:10.567491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:10.568100 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:10.568928 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:10.815551 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:10.826971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:10.833275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:10.843284 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d58b63d7-54c0-4ca0-9efb-d715a38d3842 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.286714 Aug 30 02:08:10.850057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 348/712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:10 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:11.858940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:11.859624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:11.862029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=8 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:11.868508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:11.868997 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:11.869431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:11.870171 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:11.870627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:11.871051 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:12.084622 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:12.094165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:12.095913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:12.097100 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b9672605-bfb6-43e0-b0bb-64dc5e3f7059 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.242582 Aug 30 02:08:12.097679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 365/713] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:11 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:12.950175 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-9517b5e4-305f-4863-a1d4-8947a3e7451b req-ddfde3e4-4a53-4190-9a99-34c092210690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "name": "network-vif-plugged", "status": "completed", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:12.962899 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-9517b5e4-305f-4863-a1d4-8947a3e7451b req-ddfde3e4-4a53-4190-9a99-34c092210690 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:12.963385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-9517b5e4-305f-4863-a1d4-8947a3e7451b req-ddfde3e4-4a53-4190-9a99-34c092210690 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:12.963818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-9517b5e4-305f-4863-a1d4-8947a3e7451b req-ddfde3e4-4a53-4190-9a99-34c092210690 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:12.977159 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-9517b5e4-305f-4863-a1d4-8947a3e7451b req-ddfde3e4-4a53-4190-9a99-34c092210690 service nova] Creating event network-vif-plugged:fe64b060-7adc-4085-b29b-f081c84456b4 for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 on hv-cinder-81966 Aug 30 02:08:12.982282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-9517b5e4-305f-4863-a1d4-8947a3e7451b req-ddfde3e4-4a53-4190-9a99-34c092210690 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036468 Aug 30 02:08:12.982868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 349/714] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:13.121580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:13.122196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:13.136176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:13.136675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:13.137125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:13.137862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:13.138335 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:13.138754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:13.294512 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:13.303182 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:13.306416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:13.307726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3fcec29f-8308-4516-9cbc-a85b4efdafda tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.191421 Aug 30 02:08:13.310062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 366/715] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:13 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:08:14.333255 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:14.334212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:14.340404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:14.340885 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:14.341324 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.342040 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:14.342496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:14.343745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:14.495930 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:14.504147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:14.505631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:14.506728 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8bd03a51-7295-470b-965f-6d18a6fe7f7e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1407 microversion: 2.20 time: 0.178285 Aug 30 02:08:14.508371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 350/716] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:14 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:15.535579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:15.536181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:15.543435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.543903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.544332 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.545022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.545486 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.545908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.683102 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.695384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.697030 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:15.698540 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-facca760-381b-4ba6-a6c6-359e037f1dec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1600 microversion: 2.20 time: 0.167022 Aug 30 02:08:15.699551 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 367/717] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:08:15 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:08:15.722302 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:15.723869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:15.735783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.736387 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.736937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.737951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:15.738408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:15.738866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:15.821087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0d22927d-f392-48e5-9f66-f75a2296cdde tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103737 Aug 30 02:08:15.821795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 351/718] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 02:08:15 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:08:16.923970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-d593eeea-42f7-4630-a9e9-c98d37959aaf req-63bc134b-633a-4558-bef1-43bedbde89d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:16.937176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d593eeea-42f7-4630-a9e9-c98d37959aaf req-63bc134b-633a-4558-bef1-43bedbde89d7 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:16.937176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d593eeea-42f7-4630-a9e9-c98d37959aaf req-63bc134b-633a-4558-bef1-43bedbde89d7 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:16.937176 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d593eeea-42f7-4630-a9e9-c98d37959aaf req-63bc134b-633a-4558-bef1-43bedbde89d7 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:16.947697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-d593eeea-42f7-4630-a9e9-c98d37959aaf req-63bc134b-633a-4558-bef1-43bedbde89d7 service nova] Creating event network-changed:fe64b060-7adc-4085-b29b-f081c84456b4 for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 on hv-cinder-81966 Aug 30 02:08:16.952719 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-d593eeea-42f7-4630-a9e9-c98d37959aaf req-63bc134b-633a-4558-bef1-43bedbde89d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033198 Aug 30 02:08:16.953403 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 368/719] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:17.963006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:17.965270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:17.971185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:17.971663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:17.972091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:17.972776 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:17.973223 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:17.973730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.006465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8d21fe6c-fc87-40d7-8a06-871d5d1c173b tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048174 Aug 30 02:08:18.007535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 352/720] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:17 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:18.154105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:18.154827 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:18.161006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.161518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.161955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.162643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.163278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.164287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.193508 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-85e67d4c-57bf-4231-bf3d-43f56022f87f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/5a70e598-2a1b-4594-8806-30682c3b7bfd" status: 200 len: 194 microversion: 2.1 time: 0.044363 Aug 30 02:08:18.197619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 369/721] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 30 02:08:18 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/5a70e598-2a1b-4594-8806-30682c3b7bfd => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:18.204342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:18.204832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:18.211512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.212144 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.212573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.213294 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:18.213866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:18.214483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:18.299267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lazy-loading 'services' on Instance uuid 47e1a41d-5ba1-4f10-9a70-e87230e90757 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:18.541168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e84b7ac2-7202-484a-8cda-81eb1b3f6ef5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/5a70e598-2a1b-4594-8806-30682c3b7bfd" status: 202 len: 0 microversion: 2.1 time: 0.339030 Aug 30 02:08:18.541168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 353/722] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:08:18 2022] DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/5a70e598-2a1b-4594-8806-30682c3b7bfd => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:20.735089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:20.735629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:20.742952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.743749 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.744188 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.744906 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.745362 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.746002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.778476 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0dd9b65a-c37f-408f-8e61-2bb60b2f22a6 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/0979e4bb-16b0-41f5-ab79-1fe294c11c02" status: 200 len: 194 microversion: 2.1 time: 0.046347 Aug 30 02:08:20.784602 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 370/723] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 30 02:08:20 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/0979e4bb-16b0-41f5-ab79-1fe294c11c02 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:20.792290 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:20.793054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:20.799646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.800139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.800578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.801293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:20.801822 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:20.802251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:20.895966 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lazy-loading 'services' on Instance uuid 47e1a41d-5ba1-4f10-9a70-e87230e90757 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:21.184073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b6fc504b-6252-40b1-80fa-8832dde9f4c3 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/0979e4bb-16b0-41f5-ab79-1fe294c11c02" status: 202 len: 0 microversion: 2.1 time: 0.397377 Aug 30 02:08:21.184781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 354/724] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:08:20 2022] DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments/0979e4bb-16b0-41f5-ab79-1fe294c11c02 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:22.400412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:22.404407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:22.411766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.416234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.416234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.416234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.416234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.416625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.453394 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-edaf9ba9-ac68-4a99-bb3f-3dcb8247c402 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057899 Aug 30 02:08:22.454539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 371/725] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:22 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:08:22.587293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:22.590527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:22.598799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.599544 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.601865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.601865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.602279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.602873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.637125 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b82b5e8f-9a24-48aa-906b-c64a8c513a91 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054664 Aug 30 02:08:22.637765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 355/726] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:22 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:08:22.729642 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:22.730388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:22.738019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.738711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.739319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.740247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:22.740858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:22.742194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:22.777754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:08:23.121429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1165f19c-af69-48f4-8d7b-1090873bdfa5 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 204 len: 0 microversion: 2.1 time: 0.403915 Aug 30 02:08:23.121989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 372/727] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:22 2022] DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:08:23.130104 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:23.130698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:23.136863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.137338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.137812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.138489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:23.138937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:23.141756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:23.273189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:23.281338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-12b27e3b-788c-4eb9-9c03-a45c8799e03a tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1673 microversion: 2.1 time: 0.155033 Aug 30 02:08:23.281971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 356/728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:23 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:24.304253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:24.305125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:24.311708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.312405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.312837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.313718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:24.314237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:24.314854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:24.529894 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:24.537853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1b529cab-efb6-43af-824a-977039a874ac tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1673 microversion: 2.1 time: 0.238400 Aug 30 02:08:24.539299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 373/729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:24 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:25.561676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:25.562596 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:25.569968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:25.570996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:25.571544 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:25.572323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:25.572983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:25.573501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:25.862472 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:25.879016 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d74d547f-369e-4d8f-97f8-e17960c45195 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1673 microversion: 2.1 time: 0.321998 Aug 30 02:08:25.879937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 357/730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:25 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1673 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:26.663357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-934702ec-6736-4f20-91e8-e1ddbc76e5f9 req-a7e4fac3-3a6c-46ff-8213-2b4567b75586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e1a41d-5ba1-4f10-9a70-e87230e90757", "name": "network-vif-deleted", "tag": "91d06765-5bf0-4621-b65c-3234580e7137"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:26.675434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-934702ec-6736-4f20-91e8-e1ddbc76e5f9 req-a7e4fac3-3a6c-46ff-8213-2b4567b75586 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.675910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-934702ec-6736-4f20-91e8-e1ddbc76e5f9 req-a7e4fac3-3a6c-46ff-8213-2b4567b75586 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.676337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-934702ec-6736-4f20-91e8-e1ddbc76e5f9 req-a7e4fac3-3a6c-46ff-8213-2b4567b75586 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.698731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-934702ec-6736-4f20-91e8-e1ddbc76e5f9 req-a7e4fac3-3a6c-46ff-8213-2b4567b75586 service nova] Creating event network-vif-deleted:91d06765-5bf0-4621-b65c-3234580e7137 for instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 on hv-cinder-81966 Aug 30 02:08:26.698731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-934702ec-6736-4f20-91e8-e1ddbc76e5f9 req-a7e4fac3-3a6c-46ff-8213-2b4567b75586 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038598 Aug 30 02:08:26.699308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 374/731] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:26.902319 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:26.903539 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:26.928601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.940154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.940844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:26.941793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:26.944506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:26.945796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:27.044565 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda980735a1f4948ba695e6c2788f3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbdcc426c3f4d3090919f1a50e3d626', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:27.053793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-56cfc3b1-b0a7-462e-bbda-9e3cebee5029 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 200 len: 1322 microversion: 2.1 time: 0.156602 Aug 30 02:08:27.054382 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 358/732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:26 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:28.076435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:28.077799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:28.088009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:28.089535 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:28.090277 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:28.090916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:28.091887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:28.092564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:28.093188 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:28.109866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] HTTP exception thrown: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Request method failure captured: Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 HTTP/1.1 Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-mJgd-hJiEKDb_4_URdFj9vbD250szd6nLcvZeIZlXZJ5HKIBtkKkVN_F1yPT6PJTYPurz50u47qDgQxZWxTpHX6eqXnmYk92FlA4s5ZU14fMvhzNmv3XgfghZ0pU24tZ7yEg1B5liQEvKWy47QGOtI3cYP_wBQtdacIHOOWP9HEg Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:28.111725 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: bda980735a1f4948ba695e6c2788f3b4 Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:28.113774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '47e1a41d-5ba1-4f10-9a70-e87230e90757'} Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:28.114561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:28.116218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:28.117338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Returning 404 to user: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:28.117338 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-16f95f9a-ec0a-41ba-8461-359448489e4f tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 404 len: 111 microversion: 2.1 time: 0.043218 Aug 30 02:08:28.118821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 375/733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:28 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:28.124583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7eb0697e-a1d9-4fff-8ce8-753b6809a3eb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '.version_select at 0x7f47364479d0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:28.136333 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:28.261574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7eb0697e-a1d9-4fff-8ce8-753b6809a3eb tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077357142" status: 202 len: 0 microversion: 2.1 time: 0.141187 Aug 30 02:08:28.265208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 359/734] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 02:08:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1077357142 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:30.931795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a80c7ad6-23bd-4055-a051-7f413f7daed4 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Action: 'create', calling method: .version_select at 0x7f4736245160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1690764204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmnuDCFOW4f2wgFQcQ7e4ALROna+4IpIMVjMT2vlnlp/NLwRxQ59rmol6TjTFOZqkD/NVHByhFm22sJGEd3LwGQB3c0EDpbOzcYmkw0JAPsMv7BT3PLFeunvK89kWOCEg=="}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:30.946988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-a80c7ad6-23bd-4055-a051-7f413f7daed4 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Getting quotas for project 7e5b69be3a9b4ec0b5038f51a918bf27. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:08:30.950871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-a80c7ad6-23bd-4055-a051-7f413f7daed4 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Getting quotas for user 04f1ec1a3d964e34838b14f636cdf13d and project 7e5b69be3a9b4ec0b5038f51a918bf27. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:08:31.071948 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a80c7ad6-23bd-4055-a051-7f413f7daed4 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308609 Aug 30 02:08:31.072734 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 376/735] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:08:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:32.270438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:32.270960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:32.292661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:32.293163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:32.293631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:32.294336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:32.294793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:32.295223 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:32.311938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] HTTP exception thrown: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Request method failure captured: Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 HTTP/1.1 Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-mJgd-hJiEKDb_4_URdFj9vbD250szd6nLcvZeIZlXZJ5HKIBtkKkVN_F1yPT6PJTYPurz50u47qDgQxZWxTpHX6eqXnmYk92FlA4s5ZU14fMvhzNmv3XgfghZ0pU24tZ7yEg1B5liQEvKWy47QGOtI3cYP_wBQtdacIHOOWP9HEg Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:32.316010 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: bda980735a1f4948ba695e6c2788f3b4 Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.317952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '47e1a41d-5ba1-4f10-9a70-e87230e90757'} Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:32.318893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.320723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.321971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Returning 404 to user: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:32.321971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-641e3d7c-92f1-4095-b33c-5e0a88570bb9 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 404 len: 111 microversion: 2.1 time: 0.048917 Aug 30 02:08:32.321971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 360/736] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:32 2022] DELETE /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:32.325545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:32.326166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 47e1a41d-5ba1-4f10-9a70-e87230e90757] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:32.333530 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:32.335037 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:32.335416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:32.336125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:32.336586 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:32.337013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:32.351512 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] HTTP exception thrown: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Request method failure captured: Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 HTTP/1.1 Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-mJgd-hJiEKDb_4_URdFj9vbD250szd6nLcvZeIZlXZJ5HKIBtkKkVN_F1yPT6PJTYPurz50u47qDgQxZWxTpHX6eqXnmYk92FlA4s5ZU14fMvhzNmv3XgfghZ0pU24tZ7yEg1B5liQEvKWy47QGOtI3cYP_wBQtdacIHOOWP9HEg Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:32.352934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: bda980735a1f4948ba695e6c2788f3b4 Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.354418 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '47e1a41d-5ba1-4f10-9a70-e87230e90757'} Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:32.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. Aug 30 02:08:32.356509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:32.357594 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Returning 404 to user: Instance 47e1a41d-5ba1-4f10-9a70-e87230e90757 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:32.357594 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e13fbadf-5e03-4089-8445-c701b317c782 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757" status: 404 len: 111 microversion: 2.1 time: 0.032838 Aug 30 02:08:32.357594 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 377/737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:32 2022] GET /compute/v2.1/servers/47e1a41d-5ba1-4f10-9a70-e87230e90757 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:33.634887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.635380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:33.643251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.643797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.644151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.644867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.645314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.645764 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.660373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] HTTP exception thrown: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Request method failure captured: Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b HTTP/1.1 Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-mJgd-hJiEKDb_4_URdFj9vbD250szd6nLcvZeIZlXZJ5HKIBtkKkVN_F1yPT6PJTYPurz50u47qDgQxZWxTpHX6eqXnmYk92FlA4s5ZU14fMvhzNmv3XgfghZ0pU24tZ7yEg1B5liQEvKWy47QGOtI3cYP_wBQtdacIHOOWP9HEg Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:33.662520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: bda980735a1f4948ba695e6c2788f3b4 Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.664088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '0bf23d31-4c2f-4ae6-98c5-bc5ad966309b'} Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.666524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.668092 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Returning 404 to user: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.668092 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-03682415-e93a-4253-a0ca-0efc4dbde181 tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 404 len: 111 microversion: 2.1 time: 0.034005 Aug 30 02:08:33.668408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 361/738] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:33 2022] DELETE /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:33.673815 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:33.674439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] [instance: 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:33.681504 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.682001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.682472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.683174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:33.683635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:33.684061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:33.698740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] HTTP exception thrown: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Request method failure captured: Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b HTTP/1.1 Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-mJgd-hJiEKDb_4_URdFj9vbD250szd6nLcvZeIZlXZJ5HKIBtkKkVN_F1yPT6PJTYPurz50u47qDgQxZWxTpHX6eqXnmYk92FlA4s5ZU14fMvhzNmv3XgfghZ0pU24tZ7yEg1B5liQEvKWy47QGOtI3cYP_wBQtdacIHOOWP9HEg Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:33.699944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1cbdcc426c3f4d3090919f1a50e3d626"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 1cbdcc426c3f4d3090919f1a50e3d626 Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1115630632 Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: bda980735a1f4948ba695e6c2788f3b4 Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeTestJSON-1115630632-project Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.701564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '0bf23d31-4c2f-4ae6-98c5-bc5ad966309b'} Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:33.702661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. Aug 30 02:08:33.704226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:33.706188 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] Returning 404 to user: Instance 0bf23d31-4c2f-4ae6-98c5-bc5ad966309b could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:33.707024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-23f07f4f-d5af-4a1b-a917-518c625c0f1e tempest-AttachVolumeTestJSON-1115630632 tempest-AttachVolumeTestJSON-1115630632-project] 10.222.0.27 "GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b" status: 404 len: 111 microversion: 2.1 time: 0.037427 Aug 30 02:08:33.707724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 378/739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:33 2022] GET /compute/v2.1/servers/0bf23d31-4c2f-4ae6-98c5-bc5ad966309b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:37.372897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:37.373420 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:37.380204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:37.380707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:37.384556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:37.384556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:37.384556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:37.384556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:37.407586 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c1ef0020-f3b3-4984-b087-16b8a7ed1546 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/ips" status: 200 len: 151 microversion: 2.1 time: 0.038548 Aug 30 02:08:37.408193 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 362/740] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:08:37 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:39.243173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e525ff7c-445d-4425-bb7a-b5b20a64d50a"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:39.245548 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:39.252098 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:39.252577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:39.253005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:39.253722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:39.254197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:39.254619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:39.915090 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d321a9e9-fa84-40d4-9b41-393db4d9960c tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Action: 'create', calling method: .version_select at 0x7f4736447dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1615417844"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:40.107779 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aa05953e-9018-4481-848b-67c6111f89fa tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "POST /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868667 Aug 30 02:08:40.108557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 379/741] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 02:08:39 2022] POST /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:40.557592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d321a9e9-fa84-40d4-9b41-393db4d9960c tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.763956 Aug 30 02:08:40.564561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 363/742] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Aug 30 02:08:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 765 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 02:08:40.571100 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-29bc91a2-4a13-4516-8e7f-c1e4939aec76 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736283ee0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:40.622401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-29bc91a2-4a13-4516-8e7f-c1e4939aec76 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 200 len: 345 microversion: 2.1 time: 0.055357 Aug 30 02:08:40.623112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 380/743] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:40 2022] GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:41.637152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3607967b-c214-4c6d-9691-71f2d8d28fe3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47363d04c0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:41.688646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3607967b-c214-4c6d-9691-71f2d8d28fe3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 200 len: 346 microversion: 2.1 time: 0.056304 Aug 30 02:08:41.689213 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 364/744] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:41 2022] GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:41.699525 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=4 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:41.704002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-79231c83-4754-419b-b8f3-ae1829373f23 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Action: 'create', calling method: .version_select at 0x7f4736265160>, body: {"snapshot": {"volume_id": "a4827f61-f647-4a61-90bc-8be1782efa55", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-673430995"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:42.049353 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-79231c83-4754-419b-b8f3-ae1829373f23 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.350662 Aug 30 02:08:42.050090 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 381/745] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Aug 30 02:08:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:42.061288 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b244e9f5-693c-4698-88fd-9cedb61c8403 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736447f70>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.092432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b244e9f5-693c-4698-88fd-9cedb61c8403 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 286 microversion: 2.1 time: 0.034872 Aug 30 02:08:42.093015 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 365/746] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:42 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:42.104712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6ee833b8-7e79-4ad1-8176-570238d42f8d tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47362710d0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.136425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6ee833b8-7e79-4ad1-8176-570238d42f8d tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036278 Aug 30 02:08:42.137121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 382/747] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 02:08:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:42.153433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fcabc9fc-06c2-4a48-be93-a19d379b1657 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47366371f0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:42.178680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fcabc9fc-06c2-4a48-be93-a19d379b1657 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 286 microversion: 2.1 time: 0.034423 Aug 30 02:08:42.182193 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 366/748] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:42 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:43.193013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-98d74731-04e4-492a-a975-6b646a6269be tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47361e3820>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:43.224022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-98d74731-04e4-492a-a975-6b646a6269be tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 286 microversion: 2.1 time: 0.035538 Aug 30 02:08:43.224669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 383/749] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:43 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:44.237322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c00db562-7cc8-47e6-8bee-df1b32b5ba1b tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47364364c0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:44.268964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c00db562-7cc8-47e6-8bee-df1b32b5ba1b tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 286 microversion: 2.1 time: 0.036606 Aug 30 02:08:44.269580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 367/750] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:44 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:45.282264 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bbb4dfb9-86cd-4e28-948d-79c28539a6a5 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736245310>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:45.311173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bbb4dfb9-86cd-4e28-948d-79c28539a6a5 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 286 microversion: 2.1 time: 0.033143 Aug 30 02:08:45.311726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 384/751] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:45 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:46.324935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-47544679-bc65-4d88-b3e7-d178ed740db9 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47364df8b0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:46.357185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-47544679-bc65-4d88-b3e7-d178ed740db9 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 287 microversion: 2.1 time: 0.037370 Aug 30 02:08:46.357779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 368/752] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:46 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:46.368942 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-08dc0849-436b-466c-9812-328ca19f0ebf tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736283c10>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:46.514857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-08dc0849-436b-466c-9812-328ca19f0ebf tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 202 len: 0 microversion: 2.1 time: 0.150069 Aug 30 02:08:46.515438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 385/753] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 02:08:46 2022] DELETE /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:46.523571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a82cabd1-a9ce-4f37-afdb-757120035526 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736436d30>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:46.554129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a82cabd1-a9ce-4f37-afdb-757120035526 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 200 len: 286 microversion: 2.1 time: 0.034116 Aug 30 02:08:46.554738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 369/754] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:46 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:47.566920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5a6d399e-930c-46f0-8a25-34b51a197d71 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f473649aaf0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:47.592716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-5a6d399e-930c-46f0-8a25-34b51a197d71 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] HTTP exception thrown: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5a6d399e-930c-46f0-8a25-34b51a197d71 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Request method failure captured: Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 HTTP/1.1 Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXEn7rKUDmjehQ8fEUnh4fmB30Um71hckEMafYDbgSu-QjU668E_ENZ9OriQ-pmdOTsBtKykc9sHK5a_Yr4pCYE4KxYG_8ySV6YPKs53Bhukrm4xUwjS2Ntsk-1CU8V09gw1LDtJ5hn4EXcjBLfdSBcgG24upNDlschsSnWYadLSCNA Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:47.595112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 4ad6de12734d41a2a0134a2f624c204d Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '418e7310-ca7d-456b-acab-27e27006bcb9'} Aug 30 02:08:47.596520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. (HTTP 404) (Request-ID: req-38dcfa6f-2afe-464c-8ca9-9553cf5c60c8) Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.597424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:47.598889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 02:08:47.600913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5a6d399e-930c-46f0-8a25-34b51a197d71 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Returning 404 to user: Snapshot 418e7310-ca7d-456b-acab-27e27006bcb9 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5a6d399e-930c-46f0-8a25-34b51a197d71 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9" status: 404 len: 111 microversion: 2.1 time: 0.034177 Aug 30 02:08:47.602612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 386/755] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 02:08:47 2022] GET /compute/v2.1/os-snapshots/418e7310-ca7d-456b-acab-27e27006bcb9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:47.603571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:47.603984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:47.608124 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-346c069b-f274-4c72-8f14-2bd387c68f98 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47363d9160>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:47.752721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:47.753319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:47.759507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:47.759987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:47.760417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:47.761099 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:47.761722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:47.762172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:47.765957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:08:47.808946 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-346c069b-f274-4c72-8f14-2bd387c68f98 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 202 len: 0 microversion: 2.1 time: 0.207317 Aug 30 02:08:47.809719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 370/756] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:08:47 2022] DELETE /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:08:47.817861 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5a845a85-d6c4-4a4d-875c-4e51aed45500 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736436310>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:47.847631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'services' on Instance uuid 425acb15-9950-46c5-a2ed-b50c6a63c623 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:47.877595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5a845a85-d6c4-4a4d-875c-4e51aed45500 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 200 len: 345 microversion: 2.1 time: 0.063366 Aug 30 02:08:47.878163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 371/757] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:47 2022] GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:08:48.269896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8300693e-eaae-48b2-aef8-11192bd5d4c7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments/e525ff7c-445d-4425-bb7a-b5b20a64d50a" status: 202 len: 0 microversion: 2.1 time: 0.520881 Aug 30 02:08:48.270583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 387/758] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 02:08:47 2022] DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments/e525ff7c-445d-4425-bb7a-b5b20a64d50a => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:08:48.280031 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:48.282204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:48.288824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:48.289305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:48.289755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:48.290442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:48.290890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:48.291308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:48.319931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-770ce26e-d7fe-4ded-b327-40412a1b60b7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Aug 30 02:08:48.320402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 372/759] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:48 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:48.894373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-65309090-69c9-4055-96d8-279536c04603 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47362453a0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:48.922820 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-65309090-69c9-4055-96d8-279536c04603 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] HTTP exception thrown: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-65309090-69c9-4055-96d8-279536c04603 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Request method failure captured: Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 HTTP/1.1 Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXEn7rKUDmjehQ8fEUnh4fmB30Um71hckEMafYDbgSu-QjU668E_ENZ9OriQ-pmdOTsBtKykc9sHK5a_Yr4pCYE4KxYG_8ySV6YPKs53Bhukrm4xUwjS2Ntsk-1CU8V09gw1LDtJ5hn4EXcjBLfdSBcgG24upNDlschsSnWYadLSCNA Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:48.924882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 4ad6de12734d41a2a0134a2f624c204d Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'a4827f61-f647-4a61-90bc-8be1782efa55'} Aug 30 02:08:48.926300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. (HTTP 404) (Request-ID: req-e7511b30-a1be-4429-9d51-95bea2497adf) Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:48.927161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:48.929810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 02:08:48.933538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-65309090-69c9-4055-96d8-279536c04603 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Returning 404 to user: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-65309090-69c9-4055-96d8-279536c04603 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 404 len: 109 microversion: 2.1 time: 0.037727 Aug 30 02:08:48.934996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 388/760] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:48 2022] GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:48.942920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-42e4675f-c87b-4976-adae-99b67a951736 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f4736447940>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:48.972611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-42e4675f-c87b-4976-adae-99b67a951736 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] HTTP exception thrown: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-42e4675f-c87b-4976-adae-99b67a951736 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Request method failure captured: Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 HTTP/1.1 Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXEn7rKUDmjehQ8fEUnh4fmB30Um71hckEMafYDbgSu-QjU668E_ENZ9OriQ-pmdOTsBtKykc9sHK5a_Yr4pCYE4KxYG_8ySV6YPKs53Bhukrm4xUwjS2Ntsk-1CU8V09gw1LDtJ5hn4EXcjBLfdSBcgG24upNDlschsSnWYadLSCNA Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:48.974652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 4ad6de12734d41a2a0134a2f624c204d Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'a4827f61-f647-4a61-90bc-8be1782efa55'} Aug 30 02:08:48.976249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. (HTTP 404) (Request-ID: req-cadebd05-0cd6-4374-ad58-a2c3af14b021) Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:48.977492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 02:08:48.978849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 02:08:48.980145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-42e4675f-c87b-4976-adae-99b67a951736 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Returning 404 to user: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-42e4675f-c87b-4976-adae-99b67a951736 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 404 len: 109 microversion: 2.1 time: 0.038415 Aug 30 02:08:48.981491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 373/761] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 02:08:48 2022] DELETE /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:48.985436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d8a93a77-6690-4406-90d4-a866a95cf6a3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Calling method '.version_select at 0x7f47361e3e50>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:49.013889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-d8a93a77-6690-4406-90d4-a866a95cf6a3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] HTTP exception thrown: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d8a93a77-6690-4406-90d4-a866a95cf6a3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Request method failure captured: Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 HTTP/1.1 Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXEn7rKUDmjehQ8fEUnh4fmB30Um71hckEMafYDbgSu-QjU668E_ENZ9OriQ-pmdOTsBtKykc9sHK5a_Yr4pCYE4KxYG_8ySV6YPKs53Bhukrm4xUwjS2Ntsk-1CU8V09gw1LDtJ5hn4EXcjBLfdSBcgG24upNDlschsSnWYadLSCNA Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:49.015902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/762802bc844445d1bcf4049d1d2dbad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: 762802bc844445d1bcf4049d1d2dbad4 Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-179369834 Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 4ad6de12734d41a2a0134a2f624c204d Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesSnapshotsTestJSON-179369834-project Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'a4827f61-f647-4a61-90bc-8be1782efa55'} Aug 30 02:08:49.017495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. (HTTP 404) (Request-ID: req-1b8fee30-d625-4692-bde2-cc32dd5155c8) Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:49.018300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 02:08:49.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 02:08:49.020747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d8a93a77-6690-4406-90d4-a866a95cf6a3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] Returning 404 to user: Volume a4827f61-f647-4a61-90bc-8be1782efa55 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d8a93a77-6690-4406-90d4-a866a95cf6a3 tempest-VolumesSnapshotsTestJSON-179369834 tempest-VolumesSnapshotsTestJSON-179369834-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55" status: 404 len: 109 microversion: 2.1 time: 0.036988 Aug 30 02:08:49.022240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 389/762] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:08:48 2022] GET /compute/v2.1/os-volumes/a4827f61-f647-4a61-90bc-8be1782efa55 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:08:49.333178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:49.336428 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:49.342758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:49.343264 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:49.343691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:49.344400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:49.344860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:49.345292 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:49.374890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-23663d6c-8a14-479c-a326-7ec0487a4872 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045953 Aug 30 02:08:49.375457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 374/763] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 02:08:49 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 02:08:49.438923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:49.439551 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:49.446743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:49.447271 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:49.447707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:49.448603 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:49.450006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:49.450450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:49.475986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:08:49.870578 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-099a9ded-9106-49e6-afce-337a12f7050b tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 204 len: 0 microversion: 2.1 time: 0.435449 Aug 30 02:08:49.871877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 390/764] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:49 2022] DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:08:49.880646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:49.881356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:49.890075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:49.890908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:49.891339 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:49.892361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:49.892954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:49.893296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:50.079945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:50.087570 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7d02e491-acd5-4858-a810-a5cc97fbd714 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1683 microversion: 2.1 time: 0.211154 Aug 30 02:08:50.089557 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 375/765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:49 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:50.230516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2123852099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1690764204", "security_groups": [{"name": "tempest-secgroup-smoke-583771606"}], "networks": [{"uuid": "617705e6-55ab-435e-8b2e-d504bcaf4b6b"}], "block_device_mapping_v2": [{"uuid": "8ce3d9e2-fc6e-410b-9c9f-ae24c04ea287", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:50.346663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] validate_networks() for [('617705e6-55ab-435e-8b2e-d504bcaf4b6b', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:08:50.824857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:08:50.825301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:08:50.825873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:08:50.826350 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:08:50.826763 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:08:50.835514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:50.835989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:50.836419 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:50.837139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:50.837628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:50.838052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:50.855727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Getting quotas for project 7e5b69be3a9b4ec0b5038f51a918bf27. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:08:50.859591 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Getting quotas for user 04f1ec1a3d964e34838b14f636cdf13d and project 7e5b69be3a9b4ec0b5038f51a918bf27. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:08:50.916160 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:08:50.919184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ce3d9e2-fc6e-410b-9c9f-ae24c04ea287',volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:08:51.108634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:51.109246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:51.115598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:51.116080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:51.116516 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:51.117204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:51.117690 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:51.118119 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:51.260642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:51.269873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-caf7d8f1-cb40-43ac-89d1-8969ca2b0f99 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1683 microversion: 2.1 time: 0.165229 Aug 30 02:08:51.270446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 376/766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:51 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:08:51.443480 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0adcb97a-a818-4d09-8d18-95b3fec3937b tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.217551 Aug 30 02:08:51.444139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 391/767] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:08:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:08:51.456545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5e3a8393-3f85-4be5-92cf-f52ae4c1fff7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:51.458459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5e3a8393-3f85-4be5-92cf-f52ae4c1fff7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:51.546719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5e3a8393-3f85-4be5-92cf-f52ae4c1fff7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:51.569076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5e3a8393-3f85-4be5-92cf-f52ae4c1fff7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1089 microversion: 2.1 time: 0.112269 Aug 30 02:08:51.576286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 377/768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:51 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1089 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:52.291662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:52.292281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:52.299448 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:52.300121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:52.300563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:52.301278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:52.301766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:52.302214 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:52.376146 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:52.385013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ad326e5b-00d1-47f3-a99d-ee55ececa8a3 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1615 microversion: 2.1 time: 0.097285 Aug 30 02:08:52.391469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 392/769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:52 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:52.589114 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:52.589816 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:52.598803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:52.599585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:52.600704 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:52.602619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:52.603416 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:52.604046 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:52.727385 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:52.731322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-9f5bdbe3-29c0-405b-ad0a-11376bb01172 req-65552927-f2c4-4fe6-b8e6-43a31ad3ce1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425acb15-9950-46c5-a2ed-b50c6a63c623", "name": "network-vif-deleted", "tag": "4ec91ba2-bb53-4e38-acb6-5ef19b92eb86"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:52.737200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4002769a-7f93-4a19-8fdd-66a4930865d7 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1139 microversion: 2.1 time: 0.151923 Aug 30 02:08:52.737818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 378/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:52 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1139 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:08:52.744787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-9f5bdbe3-29c0-405b-ad0a-11376bb01172 req-65552927-f2c4-4fe6-b8e6-43a31ad3ce1d service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:52.745326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-9f5bdbe3-29c0-405b-ad0a-11376bb01172 req-65552927-f2c4-4fe6-b8e6-43a31ad3ce1d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:52.746095 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-9f5bdbe3-29c0-405b-ad0a-11376bb01172 req-65552927-f2c4-4fe6-b8e6-43a31ad3ce1d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:52.918297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-9f5bdbe3-29c0-405b-ad0a-11376bb01172 req-65552927-f2c4-4fe6-b8e6-43a31ad3ce1d service nova] Creating event network-vif-deleted:4ec91ba2-bb53-4e38-acb6-5ef19b92eb86 for instance 425acb15-9950-46c5-a2ed-b50c6a63c623 on hv-cinder-81966 Aug 30 02:08:52.923469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-9f5bdbe3-29c0-405b-ad0a-11376bb01172 req-65552927-f2c4-4fe6-b8e6-43a31ad3ce1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198966 Aug 30 02:08:52.924168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 393/771] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:53.407384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:53.408008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:53.414288 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:53.414778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:53.415250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:53.415949 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:53.416441 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:53.417054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:53.449734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:53.454873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:53.454873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:53.454873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lazy-loading 'fault' on Instance uuid 425acb15-9950-46c5-a2ed-b50c6a63c623 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:08:53.492409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7af1c1123b2e458b84248865287bd00e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c57bc7a319f14bf393e6249b2cb59c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:53.500947 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a9580b1e-8b49-4b3c-8880-ad24dffb68a6 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 200 len: 1331 microversion: 2.1 time: 0.097397 Aug 30 02:08:53.504906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 379/772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:53 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:53.760854 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:53.761780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:53.767871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:53.768358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:53.768843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:53.769562 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:53.770018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:53.770441 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:53.835916 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:53.844479 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0ea1ebec-45a8-46f3-9536-cc614276c1b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1187 microversion: 2.1 time: 0.088290 Aug 30 02:08:53.845026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 394/773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:53 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:08:54.522658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:54.523274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:54.529987 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:54.531361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:54.531818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:54.532544 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:54.533005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:54.533432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:54.548583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 HTTP/1.1 Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:54.550145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:54.551779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '425acb15-9950-46c5-a2ed-b50c6a63c623'} Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:54.552644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:54.553901 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:54.555041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:54.555041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2e820953-13c9-4c22-bbc6-ff78c01bf953 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 404 len: 111 microversion: 2.1 time: 0.032990 Aug 30 02:08:54.555041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 380/774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:54 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:54.561505 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0ea6f951-307e-44ef-a59d-9d990ab867c9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '.version_select at 0x7f47361f1ee0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:54.689837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0ea6f951-307e-44ef-a59d-9d990ab867c9 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708838247" status: 202 len: 0 microversion: 2.1 time: 0.132495 Aug 30 02:08:54.690821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 395/775] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 02:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708838247 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 02:08:54.866535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:54.867154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:54.873744 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:54.874229 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:54.874663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:54.875358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:54.875814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:54.876244 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:54.945899 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:54.971027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-34100747-593a-4c1b-acd9-001473835d39 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1205 microversion: 2.1 time: 0.096144 Aug 30 02:08:54.971027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 381/776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:54 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:55.981074 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:55.981699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:55.988326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:55.988805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:55.989231 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:55.989946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:55.990395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:55.990814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:56.047863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-07ffb9ed-2425-4fc5-ae6d-a78ba4e456a4 req-ec0c6441-10f5-4b8e-b33f-6c407e00f868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:08:56.060065 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-07ffb9ed-2425-4fc5-ae6d-a78ba4e456a4 req-ec0c6441-10f5-4b8e-b33f-6c407e00f868 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:56.060869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-07ffb9ed-2425-4fc5-ae6d-a78ba4e456a4 req-ec0c6441-10f5-4b8e-b33f-6c407e00f868 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:56.061564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-07ffb9ed-2425-4fc5-ae6d-a78ba4e456a4 req-ec0c6441-10f5-4b8e-b33f-6c407e00f868 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:56.073664 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-07ffb9ed-2425-4fc5-ae6d-a78ba4e456a4 req-ec0c6441-10f5-4b8e-b33f-6c407e00f868 service nova] Creating event network-changed:ad71926d-6c2f-4698-a7f2-9471cb54c167 for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 on hv-cinder-81966 Aug 30 02:08:56.079432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-07ffb9ed-2425-4fc5-ae6d-a78ba4e456a4 req-ec0c6441-10f5-4b8e-b33f-6c407e00f868 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037389 Aug 30 02:08:56.080365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 382/777] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:08:56.135687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:56.144395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b33a93b2-b69b-4d31-9bf7-f8d6d5297427 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.168168 Aug 30 02:08:56.144959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 396/778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:55 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:56.927661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:56.928272 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:56.935318 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:56.935798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:56.936261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:56.936938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:56.937386 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:56.937841 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:56.950700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 HTTP/1.1 Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:56.952295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.953862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '425acb15-9950-46c5-a2ed-b50c6a63c623'} Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:56.954770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.956211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.957684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:56.957684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-587c3c23-ee16-476f-86d3-4814d6688cf7 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 404 len: 111 microversion: 2.1 time: 0.030199 Aug 30 02:08:56.957684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 383/779] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:56 2022] DELETE /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:56.962277 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:56.962911 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 425acb15-9950-46c5-a2ed-b50c6a63c623] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:56.969307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:56.970421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:56.970421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:56.971091 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:56.971552 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:56.971976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:56.986779 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 HTTP/1.1 Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:56.988465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.990541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '425acb15-9950-46c5-a2ed-b50c6a63c623'} Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:56.991381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. Aug 30 02:08:56.993345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:56.999910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance 425acb15-9950-46c5-a2ed-b50c6a63c623 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:56.999910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8b480a12-96bd-47d6-890e-a05b5a21b98e tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623" status: 404 len: 111 microversion: 2.1 time: 0.031564 Aug 30 02:08:56.999910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 397/780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:56 2022] GET /compute/v2.1/servers/425acb15-9950-46c5-a2ed-b50c6a63c623 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:57.165940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:57.166495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:57.173419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:57.173919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:57.174342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:57.175021 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:57.175488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:57.175902 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:57.314851 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:57.322824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d39d8748-0d79-4113-b9b4-64a58c8921ca tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.160710 Aug 30 02:08:57.323438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 384/781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:57 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:58.345676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:58.346113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:58.353220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.353754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.354191 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.355399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.355909 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.356344 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.387962 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:58.389167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:58.396659 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.397304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.397922 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.398843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.400691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.401281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.415705 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db HTTP/1.1 Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:58.417278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.419578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '5e085f77-4bea-423b-afcd-a2c59f5210db'} Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:58.420471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.421916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.424116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:58.424955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f8e19d90-36e9-49c9-b3a6-e794dfac887a tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 404 len: 111 microversion: 2.1 time: 0.047219 Aug 30 02:08:58.425691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 385/782] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:58 2022] DELETE /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:58.435689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:58.436553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: 5e085f77-4bea-423b-afcd-a2c59f5210db] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:58.443226 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.443702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.444297 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.445021 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.445494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.445910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.460724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db HTTP/1.1 Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:58.462358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.463982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '5e085f77-4bea-423b-afcd-a2c59f5210db'} Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:58.465128 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. Aug 30 02:08:58.466616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.467937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance 5e085f77-4bea-423b-afcd-a2c59f5210db could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:58.467937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ce9b530f-8b81-4a0b-bb91-010c1ce85984 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db" status: 404 len: 111 microversion: 2.1 time: 0.033094 Aug 30 02:08:58.467937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 386/783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:58 2022] GET /compute/v2.1/servers/5e085f77-4bea-423b-afcd-a2c59f5210db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:08:58.473137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:58.473137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:58.479316 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.479798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.480948 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.481767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.482223 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.482688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.498270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 HTTP/1.1 Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:58.499697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.501323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4'} Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:58.502286 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.503798 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.505585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:58.505585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a8f70efe-4e59-47ec-9934-84cdd27c3511 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 404 len: 111 microversion: 2.1 time: 0.032757 Aug 30 02:08:58.506564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 387/784] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:58 2022] DELETE /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:58.511622 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:58.516621 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:58.519854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:58.525364 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4c01716b-9d49-416a-bedd-0bcb9ac6b5ab tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.183669 Aug 30 02:08:58.526131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.526691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 398/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:58 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:58.527259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.527802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.528521 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:58.528974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:58.529397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:58.545774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 HTTP/1.1 Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:58.547320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.548648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4'} Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:58.549368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. Aug 30 02:08:58.550580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:58.553359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:58.553359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5cb3b2e0-aeea-4404-a1a0-950464dab911 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4" status: 404 len: 111 microversion: 2.1 time: 0.041190 Aug 30 02:08:58.553359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 388/786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:58 2022] GET /compute/v2.1/servers/e5f1e0f4-4e89-4a79-b80e-c12a1fbe99b4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 02:08:59.547592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:59.548986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:59.557087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:59.557689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:59.558969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:59.561643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:59.562330 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:59.563214 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:59.707236 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:08:59.715679 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-68869971-53db-43ef-b9f4-938be384ffeb tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.172289 Aug 30 02:08:59.716462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 399/787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:59 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:08:59.848675 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:59.849189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:59.856695 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:59.866242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:59.866242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:59.866242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:59.866242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:59.866620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:59.874199 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d HTTP/1.1 Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:08:59.875755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.877306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'fa5b872f-9744-43a4-94bc-1f6c488c692d'} Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:59.878129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.879488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.881691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:59.881691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-616c6e3f-fb4d-4a9e-876c-ceb0ab92fd55 tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 404 len: 111 microversion: 2.1 time: 0.032497 Aug 30 02:08:59.881691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 389/788] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:08:59 2022] DELETE /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:08:59.886748 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:08:59.887494 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] [instance: fa5b872f-9744-43a4-94bc-1f6c488c692d] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:08:59.893724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:59.894284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:59.894788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:59.895555 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:08:59.896081 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:08:59.896579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:08:59.910902 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] HTTP exception thrown: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Request method failure captured: Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d HTTP/1.1 Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDW-nbRj9FMOZE86RwPUZXlFIVorpO4aJOmL8eUH7Cojnk9Bvn1oSCR_R8egGMBBVvmVzw1NNSzcrsB7X7pWwyxnVUC79Fy2woL7qHOdTLjV0UwICynd2FP74dkFTo-jeRIeUonmv-X6GZQV4nJSzSiBYIGy_Xbt6yij8cyeXW5JkRRM Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:08:59.912563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c57bc7a319f14bf393e6249b2cb59c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: c57bc7a319f14bf393e6249b2cb59c69 Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1441840853 Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 7af1c1123b2e458b84248865287bd00e Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeNegativeTest-1441840853-project Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.914210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'fa5b872f-9744-43a4-94bc-1f6c488c692d'} Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:08:59.915093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. Aug 30 02:08:59.917213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:08:59.920057 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] Returning 404 to user: Instance fa5b872f-9744-43a4-94bc-1f6c488c692d could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:08:59.920057 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bf524d82-5e26-4122-b470-ad425da903db tempest-AttachVolumeNegativeTest-1441840853 tempest-AttachVolumeNegativeTest-1441840853-project] 10.222.0.27 "GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d" status: 404 len: 111 microversion: 2.1 time: 0.032679 Aug 30 02:08:59.920057 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 400/789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:08:59 2022] GET /compute/v2.1/servers/fa5b872f-9744-43a4-94bc-1f6c488c692d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:09:00.345036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:00.345552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:00.351562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:00.352313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:00.352756 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:00.353436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:00.353909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:00.354332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:00.378560 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-82d355d5-ec6c-40d5-a0fc-f474ade2338e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/ips" status: 200 len: 153 microversion: 2.20 time: 0.037547 Aug 30 02:09:00.379131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 390/790] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Aug 30 02:09:00 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:09:00.736143 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:00.737162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:00.744659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:00.745230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:00.745779 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:00.747177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:00.747757 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:00.748481 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:00.845718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:00.866287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=6 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:00.901072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:00.910430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f8095da8-7c2b-44a5-aac8-2a680067cb02 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.178085 Aug 30 02:09:00.911315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 401/791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:00 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:01.932515 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:01.934671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:01.938473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:01.944315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:01.945322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:01.945978 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:01.946867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:01.947502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:01.948185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:02.195600 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:02.213975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6357670e-0eed-486e-8dbc-046e53cbe9e2 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.278856 Aug 30 02:09:02.213975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 391/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:01 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:09:02.831530 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:02.832181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:02.835104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:02.841304 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:02.842045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:02.842469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:02.843282 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:02.843891 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:02.844476 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:02.878842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lazy-loading 'flavor' on Instance uuid 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:09:03.234310 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:03.235652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:03.244758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:03.246337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:03.247248 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:03.248506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:03.249154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:03.249997 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:03.405776 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0b0a2a8f-e107-4beb-881a-84ac048c73e6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/action" status: 202 len: 0 microversion: 2.20 time: 0.577275 Aug 30 02:09:03.407584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 402/793] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 02:09:02 2022] POST /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:09:03.427811 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:03.428517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:03.435650 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:03.436398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:03.436859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:03.438043 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:03.438812 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:03.439779 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:03.463837 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:03.474868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b436df50-34cc-4f6f-82b7-5acbe82ae645 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.246378 Aug 30 02:09:03.475449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 392/794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:03 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:09:03.606698 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:03.618389 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:03.619864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:03.621186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3074f710-1e1f-4177-b994-0fc8038f1e50 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.201907 Aug 30 02:09:03.621766 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 403/795] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:03 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:04.496900 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:04.497569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:04.507654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:04.508176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:04.508622 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:04.511832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:04.511832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:04.511832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:04.645779 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:04.647296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:04.653691 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:04.661823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a85a9f63-e198-4947-93db-1a3e7050bd6c tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.168571 Aug 30 02:09:04.662637 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 393/796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:04 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:04.668186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:04.668868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:04.669484 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:04.670270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:04.670735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:04.671166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:04.848054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:04.859404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:04.861287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:04.862741 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-23cf99d2-9cee-4d18-82d3-05ebc170eb8c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.220835 Aug 30 02:09:04.863345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 404/797] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:04 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:09:05.683866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:05.684673 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:05.692026 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:05.692026 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:05.692301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:05.693024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:05.693519 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:05.693951 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:05.837438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:05.845525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f6a79a71-53ce-4765-87bf-247eb6b2d289 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.166211 Aug 30 02:09:05.846093 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 394/798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:05 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:05.890582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:05.890582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:05.893973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:05.894450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:05.894877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:05.895568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:05.896105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:05.896477 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:05.899221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:06.026498 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:06.035054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:06.036492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:06.037678 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-55ec93c0-309c-47c9-bc5b-1fa01dbe3531 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.155664 Aug 30 02:09:06.038235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 405/799] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:05 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:06.866844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:06.868084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:06.874836 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:06.876471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:06.876912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:06.877656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:06.878114 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:06.878577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:06.944715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-d60e9e2e-57c7-449f-acba-feb32d5a0002 req-f55d83f9-d417-4771-9721-ff6e9534b3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "name": "network-vif-plugged", "status": "completed", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:06.955931 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d60e9e2e-57c7-449f-acba-feb32d5a0002 req-f55d83f9-d417-4771-9721-ff6e9534b3ff service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:06.956519 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d60e9e2e-57c7-449f-acba-feb32d5a0002 req-f55d83f9-d417-4771-9721-ff6e9534b3ff service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:06.957015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d60e9e2e-57c7-449f-acba-feb32d5a0002 req-f55d83f9-d417-4771-9721-ff6e9534b3ff service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:06.969538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-d60e9e2e-57c7-449f-acba-feb32d5a0002 req-f55d83f9-d417-4771-9721-ff6e9534b3ff service nova] Creating event network-vif-plugged:ad71926d-6c2f-4698-a7f2-9471cb54c167 for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 on hv-cinder-81966 Aug 30 02:09:06.974633 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-d60e9e2e-57c7-449f-acba-feb32d5a0002 req-f55d83f9-d417-4771-9721-ff6e9534b3ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Aug 30 02:09:06.975415 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 406/800] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:09:07.024309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:07.028630 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:07.033265 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3f7f7b7f-fe2b-44f4-bd3c-ad3a45c31478 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.170300 Aug 30 02:09:07.033853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 395/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:06 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:07.070120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:07.071306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:07.081256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:07.081933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:07.082329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:07.083087 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:07.083542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:07.084134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:07.230192 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:07.238154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:07.239625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:07.240805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-81f0dfad-a419-4e1d-a863-8ab12946639b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.182705 Aug 30 02:09:07.241384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 407/802] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:07 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:08.056041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:08.056754 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:08.064200 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:08.064684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:08.065140 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:08.065847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:08.066343 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:08.066768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:08.187529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4971688d-8ce4-4173-afe5-71dd2cf879cf tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47362f34c0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:08.212653 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:08.225253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0e370096-5f55-479d-8cb4-b2a5ba14b8bf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1260 microversion: 2.1 time: 0.172722 Aug 30 02:09:08.226211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 396/803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:08 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:08.234900 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4971688d-8ce4-4173-afe5-71dd2cf879cf tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0fe2f316-df3f-410b-8e88-9ee732a7b802" status: 200 len: 351 microversion: 2.1 time: 0.056494 Aug 30 02:09:08.235469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 408/804] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:09:08 2022] GET /compute/v2.1/os-volumes/0fe2f316-df3f-410b-8e88-9ee732a7b802 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:09:08.264694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:08.265291 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:08.271230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:08.271708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:08.272141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:08.272824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:08.273306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:08.273700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:08.409871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:08.418138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:08.419701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:08.420848 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b09b655f-fab5-40d7-9994-0b2975b1c1b6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.160742 Aug 30 02:09:08.421402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 397/805] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:08 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:09.249604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:09.250210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:09.256266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:09.256749 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:09.257376 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:09.258108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:09.258555 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:09.258997 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:09.390178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:09.397982 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5fdc2531-1bf6-45ac-8bce-c983768681b3 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1445 microversion: 2.1 time: 0.153290 Aug 30 02:09:09.398577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 409/806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:09 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:09:09.419895 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:09.420533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:09.427396 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:09.427874 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:09.428308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:09.429092 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:09.429605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:09.430056 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:09.444260 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:09.444873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:09.451539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:09.452028 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:09.452464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:09.453158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:09.453654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:09.454077 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:09.567710 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:09.576552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7fcef1b1-4ed8-4fe0-bfc8-61451c6b0f0d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1445 microversion: 2.1 time: 0.160997 Aug 30 02:09:09.577054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 398/807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:09 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1445 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:09.589927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:09.598267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:09.599718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:09.600881 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5ae20806-6631-467e-8f88-3d55fbdc7721 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.160691 Aug 30 02:09:09.601445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 410/808] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:09 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:09:10.039412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-076e3a9a-381f-4127-88ff-5be6c9c194ca tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47364ff1f0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:10.092038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-076e3a9a-381f-4127-88ff-5be6c9c194ca tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c60dc302-836f-43c2-a580-9696f71bb408" status: 200 len: 351 microversion: 2.1 time: 0.057166 Aug 30 02:09:10.092634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 399/809] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:09:10 2022] GET /compute/v2.1/os-volumes/c60dc302-836f-43c2-a580-9696f71bb408 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:10.627237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:10.627870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:10.635216 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:10.635903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:10.636925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:10.638019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:10.638703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:10.639131 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:11.118570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:11.126808 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:11.128267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:11.129658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ed385164-a1a8-4206-a901-c43f363b95bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.508917 Aug 30 02:09:11.130221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 411/810] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:10 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:11.755862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bd9a0c4a-f5de-4075-9e58-1824ba8244c1 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47363f9ca0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:11.809131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bd9a0c4a-f5de-4075-9e58-1824ba8244c1 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/54ba59df-6c9c-49fc-b36c-aca50824b2b0" status: 200 len: 350 microversion: 2.1 time: 0.058072 Aug 30 02:09:11.809774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 400/811] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 02:09:11 2022] GET /compute/v2.1/os-volumes/54ba59df-6c9c-49fc-b36c-aca50824b2b0 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:11.822841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d1c4d8f0-8145-47bb-bfa5-209809808388 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f4736283790>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:11.911374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d1c4d8f0-8145-47bb-bfa5-209809808388 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092486 Aug 30 02:09:11.911940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 412/812] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 30 02:09:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:09:11.926875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3bc03d7b-7914-4e62-86bf-448c486b788b tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47363f9670>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.019134 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3bc03d7b-7914-4e62-86bf-448c486b788b tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096017 Aug 30 02:09:12.019811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 401/813] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 02:09:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:12.033949 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e863b6bb-56b6-43da-b59e-cb01e596cc17 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47362f3430>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.123072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e863b6bb-56b6-43da-b59e-cb01e596cc17 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092515 Aug 30 02:09:12.123506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 413/814] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:12.138210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-94e74a18-1636-4045-a56c-953d9751e27c tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47363f9e50>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.154558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.155971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:12.162617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:12.163442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:12.163984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:12.164792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:12.165355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:12.165908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:12.248116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-94e74a18-1636-4045-a56c-953d9751e27c tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114734 Aug 30 02:09:12.251196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 402/815] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:09:12.264374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-48cc00df-6742-4902-960c-6e81d0cf314c tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47363d9550>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.340217 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:12.350097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:12.352011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:12.353684 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c45c765a-1ff4-4514-9dc9-b733be809551 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.203656 Aug 30 02:09:12.354224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 414/816] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:12.365243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-48cc00df-6742-4902-960c-6e81d0cf314c tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095855 Aug 30 02:09:12.365243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 403/817] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:12.365243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-ba3d1c33-3bff-45c2-9fb9-9ac33bdcc096 req-c39bf4f7-e046-42ba-aa2d-4c017dcf154a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:12.371530 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-ba3d1c33-3bff-45c2-9fb9-9ac33bdcc096 req-c39bf4f7-e046-42ba-aa2d-4c017dcf154a service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:12.372116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-ba3d1c33-3bff-45c2-9fb9-9ac33bdcc096 req-c39bf4f7-e046-42ba-aa2d-4c017dcf154a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:12.372602 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-ba3d1c33-3bff-45c2-9fb9-9ac33bdcc096 req-c39bf4f7-e046-42ba-aa2d-4c017dcf154a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:12.376707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-545ef30e-a647-4cbb-a534-3f2f8b766e5f tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f4736283790>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.383720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-ba3d1c33-3bff-45c2-9fb9-9ac33bdcc096 req-c39bf4f7-e046-42ba-aa2d-4c017dcf154a service nova] Creating event network-changed:ad71926d-6c2f-4698-a7f2-9471cb54c167 for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 on hv-cinder-81966 Aug 30 02:09:12.390024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-ba3d1c33-3bff-45c2-9fb9-9ac33bdcc096 req-c39bf4f7-e046-42ba-aa2d-4c017dcf154a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032130 Aug 30 02:09:12.390713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 404/818] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:12.471625 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-545ef30e-a647-4cbb-a534-3f2f8b766e5f tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.104542 Aug 30 02:09:12.472286 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 415/819] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:12.486742 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fb4afc37-7fa1-4169-bd7f-436bb30bf646 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f4736447b80>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.575096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fb4afc37-7fa1-4169-bd7f-436bb30bf646 tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092412 Aug 30 02:09:12.575818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 405/820] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:12.588803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ce5d98d6-ec89-48b6-aa98-cb6fe4499b7f tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] Calling method '.version_select at 0x7f47362fb5e0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:12.674420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ce5d98d6-ec89-48b6-aa98-cb6fe4499b7f tempest-VolumesTestJSON-2087989461 tempest-VolumesTestJSON-2087989461-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089282 Aug 30 02:09:12.677648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 416/821] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 02:09:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:13.382367 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:13.383112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:13.390774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:13.391320 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:13.392607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:13.392607 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:13.392863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:13.393283 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:13.531093 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:13.539119 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:13.540555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:13.541741 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d939e271-a2da-469e-885c-a0b84ce54b55 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.163898 Aug 30 02:09:13.542298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 406/822] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:13 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:14.565306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:14.566829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:14.573052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:14.573604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:14.574081 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:14.574882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:14.575343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:14.575926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:14.725123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:14.734936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:14.736307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:14.737534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bed5d557-28e4-423d-aa27-78dd5c23b144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.176784 Aug 30 02:09:14.738086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 417/823] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:14 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:15.766133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:15.766755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:15.772783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:15.773269 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:15.773734 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:15.774427 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:15.774884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:15.775314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:15.910594 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:15.918915 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:15.920339 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:15.926002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f7f94f8e-6fef-48c5-9294-a45a292242eb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.160124 Aug 30 02:09:15.926002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 407/824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:15 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:16.944657 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:16.945430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:16.952169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:16.952655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:16.953096 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:16.953828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:16.954287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:16.954714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:17.095319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:17.106842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:17.108294 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:17.109479 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3e14c190-4ecf-412d-a04d-22fde9da2312 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.168719 Aug 30 02:09:17.110050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 418/825] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:16 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:09:18.133750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:18.134455 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:18.138664 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=63 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:18.142112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:18.142592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:18.143029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:18.143726 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:18.144178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:18.144594 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:18.284584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:18.294849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:18.296464 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:18.298061 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a5f39486-735e-45b9-a2a1-9adad824e2a1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.167561 Aug 30 02:09:18.298806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 408/826] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:18 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:19.322611 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:19.323446 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:19.330703 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:19.331178 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:19.337588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:19.337588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:19.337588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:19.337588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:19.496891 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:19.503697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:19.505363 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:19.506775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-139fd4c3-e4da-4468-b328-5a037c60e80b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.188423 Aug 30 02:09:19.507944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 419/827] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:19 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:20.531629 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:20.532397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:20.540634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:20.540909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:20.541357 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:20.542000 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:20.542474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:20.548246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:20.689240 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:20.697780 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:20.699276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:20.700443 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-df59fbf6-15a9-4bd4-bdb1-d8ecaedc78a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1746 microversion: 2.20 time: 0.173018 Aug 30 02:09:20.701006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 409/828] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:20 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:21.725896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:21.726574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:21.734573 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:21.735257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:21.735694 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:21.736464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:21.736901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:21.737348 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:21.890279 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:21.898873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:21.900585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:21.901834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bb1dd2c6-b554-4d46-8927-de4bdb2ab399 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.181429 Aug 30 02:09:21.902388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 420/829] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:21 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:22.933610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:22.933610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:22.945143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:22.945933 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:22.951292 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:22.952556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:22.953129 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:22.953696 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:23.036469 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-220b8520-a3ea-4d30-b343-e6570f15723d req-c59a1a18-8d3a-49a2-a69a-2b0b0a4ab521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "name": "network-vif-plugged", "status": "completed", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:23.052672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-220b8520-a3ea-4d30-b343-e6570f15723d req-c59a1a18-8d3a-49a2-a69a-2b0b0a4ab521 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:23.053566 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-220b8520-a3ea-4d30-b343-e6570f15723d req-c59a1a18-8d3a-49a2-a69a-2b0b0a4ab521 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:23.054218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-220b8520-a3ea-4d30-b343-e6570f15723d req-c59a1a18-8d3a-49a2-a69a-2b0b0a4ab521 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:23.066811 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-220b8520-a3ea-4d30-b343-e6570f15723d req-c59a1a18-8d3a-49a2-a69a-2b0b0a4ab521 service nova] Creating event network-vif-plugged:fe64b060-7adc-4085-b29b-f081c84456b4 for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 on hv-cinder-81966 Aug 30 02:09:23.074008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-220b8520-a3ea-4d30-b343-e6570f15723d req-c59a1a18-8d3a-49a2-a69a-2b0b0a4ab521 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041765 Aug 30 02:09:23.077259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 421/830] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:09:23.167532 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:23.181539 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:23.183507 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:23.197330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-eaaef686-c7f1-4dbd-aaa3-8ac794d533f4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.260983 Aug 30 02:09:23.197330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 410/831] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:22 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:24.213472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:24.214177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:24.230349 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:24.231675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:24.232110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:24.233017 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:24.233632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:24.234407 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:24.396967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:24.408842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:24.410312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:24.411493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8b4c68fb-c06a-4aa2-84fb-f624f0b5a646 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.203216 Aug 30 02:09:24.412052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 422/832] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:24 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:25.436030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:25.436634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:25.443474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:25.443965 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:25.444401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:25.445111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:25.445598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:25.446025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:25.586134 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:25.597186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:25.598665 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:25.599851 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d84a6276-964d-48f3-919d-1e3b8b3a5fbf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.168185 Aug 30 02:09:25.600434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 411/833] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:25 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:26.626016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:26.627514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:26.635173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:26.636072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:26.637712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:26.639019 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:26.639648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:26.640306 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:26.806247 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:26.816234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:26.821706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:26.824094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-99ae90b5-1eca-4033-988b-3af17a3b0c79 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.203769 Aug 30 02:09:26.825273 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 423/834] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:26 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:27.852941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:27.853738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:27.861858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:27.862351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:27.862789 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:27.863492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:27.863945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:27.864372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:27.998043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:28.007092 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:28.008699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:28.009949 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-94a9eecc-01e8-4111-9fa7-7ad17a29b3de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.163602 Aug 30 02:09:28.010503 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 412/835] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:27 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:29.034683 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:29.035464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:29.042313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:29.043067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:29.044018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:29.045228 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:29.047289 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:29.050565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:29.229741 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:29.247281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:29.252355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:29.252355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c71a9eb3-f9a0-4017-96ec-2cd2ceb12384 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.220499 Aug 30 02:09:29.252355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 424/836] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:29 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:30.275254 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:30.276636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:30.288076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:30.291416 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:30.294184 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:30.296752 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:30.297876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:30.298591 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:30.476809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:30.486477 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:30.488880 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:30.490066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a4bbd4ac-512b-4bc7-b45c-7606fc7afed4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.218662 Aug 30 02:09:30.491234 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 413/837] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:30 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:31.515323 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:31.515941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:31.522326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:31.522852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:31.523287 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:31.523974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:31.524423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:31.524840 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:31.674545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:31.678528 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:31.679967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:31.681124 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2b1f8d7b-a0f7-4123-9c9c-06b4c9274d06 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.170483 Aug 30 02:09:31.682073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 425/838] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:31 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:32.705172 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:32.705860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:32.712611 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:32.713131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:32.713631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:32.714391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:32.714865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:32.715274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:32.858781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:32.877152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:32.877152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:32.877152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ddb79c4e-b76b-460d-8cef-09549127de6c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1741 microversion: 2.20 time: 0.171374 Aug 30 02:09:32.882328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 414/839] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:32 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:33.898046 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:33.899493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:33.907464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:33.908388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:33.911777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:33.911777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:33.911777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:33.911777 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:34.056131 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:34.064300 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:34.065829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:34.066937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e1f1ca3f-70ce-4d30-9fc3-c3fe79b05454 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.174026 Aug 30 02:09:34.067499 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 426/840] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:33 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:35.091318 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:35.092034 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:35.098426 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:35.098909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:35.099341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:35.100038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:35.100488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:35.100909 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:35.231894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:35.239960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:35.241383 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:35.242576 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f592203b-09cb-4db0-87e1-fa7827a0e1f2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1723 microversion: 2.20 time: 0.155953 Aug 30 02:09:35.243113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 415/841] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:35 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:35.787967 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1164290590", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "networks": [{"uuid": "679b03cb-c332-4214-9386-ac405add0f6b"}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:35.845065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] validate_networks() for [('679b03cb-c332-4214-9386-ac405add0f6b', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:09:36.202805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:09:36.203301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:09:36.203855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:09:36.204299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:09:36.204716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:09:36.206857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=42 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:36.214838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:36.215433 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:36.216586 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:36.217580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:36.218069 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:36.218502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:36.236071 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Getting quotas for project dbcd3b31535f46308cd1a15fd66538f0. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:09:36.240016 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Getting quotas for user ad16b4f1dfc94571bfcd4554ff588c86 and project dbcd3b31535f46308cd1a15fd66538f0. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:09:36.250961 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:09:36.253246 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:09:36.266253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:36.266857 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:36.273803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:36.274478 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:36.275036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:36.275823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:36.276370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:36.276914 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:36.411245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:36.419676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:36.424152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:36.424152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8f501c9a-4322-4fdb-90a2-2878243bce7d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1726 microversion: 2.20 time: 0.160694 Aug 30 02:09:36.424152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 416/842] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:36 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:36.442544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e7aca7da-c00d-43f1-b2d3-092735cacc27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658351 Aug 30 02:09:36.443184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 427/843] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:09:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:09:36.448727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af6a36ab-8913-4738-9d61-d257e8c96fa5"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:36.448727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:36.454490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2608d6c6-7470-4f9a-927a-eaf8af0b3367 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:36.454862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:36.455105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2608d6c6-7470-4f9a-927a-eaf8af0b3367 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:36.455342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:36.455772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:36.456465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:36.457113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:36.457590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:36.516587 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2608d6c6-7470-4f9a-927a-eaf8af0b3367 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:36.527719 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2608d6c6-7470-4f9a-927a-eaf8af0b3367 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1214 microversion: 2.1 time: 0.077583 Aug 30 02:09:36.528932 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 428/844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:36 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:37.027742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-2cf4a5bf-5444-492c-8449-20c2ef4069ef req-9de6465e-6bc4-4fea-b981-3ccab9fb4210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:37.038448 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-2cf4a5bf-5444-492c-8449-20c2ef4069ef req-9de6465e-6bc4-4fea-b981-3ccab9fb4210 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:37.038925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-2cf4a5bf-5444-492c-8449-20c2ef4069ef req-9de6465e-6bc4-4fea-b981-3ccab9fb4210 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:37.039445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-2cf4a5bf-5444-492c-8449-20c2ef4069ef req-9de6465e-6bc4-4fea-b981-3ccab9fb4210 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:37.051009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.compute.server_external_events [req-2cf4a5bf-5444-492c-8449-20c2ef4069ef req-9de6465e-6bc4-4fea-b981-3ccab9fb4210 service nova] Unable to find a host for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9. Dropping event network-vif-unplugged {{(pid=121094) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 02:09:37.051957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-2cf4a5bf-5444-492c-8449-20c2ef4069ef req-9de6465e-6bc4-4fea-b981-3ccab9fb4210 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028022 Aug 30 02:09:37.052553 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 429/845] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 02:09:37.255662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:37.548735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dc66a7a5-0af2-4ec9-9fc7-f121e37a8aee tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:37.549340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-dc66a7a5-0af2-4ec9-9fc7-f121e37a8aee tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:37.600771 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-dc66a7a5-0af2-4ec9-9fc7-f121e37a8aee tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:37.607847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dc66a7a5-0af2-4ec9-9fc7-f121e37a8aee tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1214 microversion: 2.1 time: 0.063065 Aug 30 02:09:37.608439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 430/846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:37 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:09:37.622280 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-dd3b7184-f2e2-45fc-87d2-decf78a4593e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.181043 Aug 30 02:09:37.622892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 417/847] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 30 02:09:36 2022] POST /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments => generated 188 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 02:09:37.748559 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:37.749207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:37.765937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:37.766458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:37.766900 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:37.767606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:37.768063 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:37.768494 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:37.783473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:37.812965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121094) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 02:09:38.193439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c6d685e1-fb7b-4bb8-bec3-c9a91deea10c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/action" status: 202 len: 0 microversion: 2.20 time: 0.448727 Aug 30 02:09:38.194079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 431/848] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 02:09:37 2022] POST /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:09:38.203114 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:38.203718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:38.211562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:38.212107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:38.212536 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:38.213228 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:38.213883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:38.214356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:38.343582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:38.353414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:38.355186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:38.356403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5253d2aa-cd14-40b1-b642-e3fd11736a46 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.158017 Aug 30 02:09:38.357142 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 418/849] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:38 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:09:38.628758 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:38.629374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:38.635372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:38.635855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:38.636292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:38.636981 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:38.637431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:38.637892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:38.702774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:38.711793 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b73243d5-a041-40d2-b59f-899654e3ba06 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1266 microversion: 2.1 time: 0.087231 Aug 30 02:09:38.712430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 432/850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:38 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:39.380357 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:39.381045 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:39.387713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:39.388287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:39.388819 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:39.389618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:39.390672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:39.391412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:39.617935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:39.635001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:39.635496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:39.637169 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-306119f9-4f37-4255-910f-7b191499ff3a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1752 microversion: 2.20 time: 0.260823 Aug 30 02:09:39.639182 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 419/851] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:39 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1752 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:39.734865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:39.735473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:39.742797 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:39.743276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:39.743708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:39.744405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:39.744862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:39.745274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:39.889975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:39.898337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-227d770d-9bdf-4625-91fd-457a08309681 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.168451 Aug 30 02:09:39.899006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 433/852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:39 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:40.663023 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:40.663791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:40.670030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:40.670505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:40.670932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:40.672233 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:40.672806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:40.673327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:40.802746 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:40.811353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:40.813589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:40.814922 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a2b1e370-b917-44d1-aedf-adfc6a36047a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1754 microversion: 2.20 time: 0.155845 Aug 30 02:09:40.815341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 420/853] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:40 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:40.845797 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-bf4c6bfb-65d5-4ec0-ba09-76a17a927641 req-3d190c2f-623d-4cdc-8fed-ef4848f8290f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f61075-91c8-496b-9db8-bf335ed40b41", "tag": "8759456a-36e8-4421-a077-babbd546c544"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:40.855852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-bf4c6bfb-65d5-4ec0-ba09-76a17a927641 req-3d190c2f-623d-4cdc-8fed-ef4848f8290f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:40.856322 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-bf4c6bfb-65d5-4ec0-ba09-76a17a927641 req-3d190c2f-623d-4cdc-8fed-ef4848f8290f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:40.856819 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-bf4c6bfb-65d5-4ec0-ba09-76a17a927641 req-3d190c2f-623d-4cdc-8fed-ef4848f8290f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:40.869313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-bf4c6bfb-65d5-4ec0-ba09-76a17a927641 req-3d190c2f-623d-4cdc-8fed-ef4848f8290f service nova] Creating event network-changed:8759456a-36e8-4421-a077-babbd546c544 for instance f3f61075-91c8-496b-9db8-bf335ed40b41 on hv-cinder-81966 Aug 30 02:09:40.874855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-bf4c6bfb-65d5-4ec0-ba09-76a17a927641 req-3d190c2f-623d-4cdc-8fed-ef4848f8290f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033227 Aug 30 02:09:40.875728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 434/854] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:40.919937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:40.920592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:40.928312 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:40.928938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:40.929536 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:40.930484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:40.931273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:40.931774 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:41.211681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:41.220419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b4ef8abb-97b8-4b01-9104-986596ba981c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.304649 Aug 30 02:09:41.220994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 421/855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:40 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:41.839408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:41.840050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:41.846559 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:41.847181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:41.847453 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:41.851388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:41.851388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:41.851388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:41.984012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:41.992674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:41.994173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:41.995293 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aba64d96-c379-4152-acbd-c179484195a5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.160206 Aug 30 02:09:41.995839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 435/856] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:41 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:42.242245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:42.242829 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:42.249834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:42.250430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:42.250809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:42.251502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:42.252251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:42.252686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:42.380910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:42.388595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-53ab1855-dce6-485f-a233-ff44b4f8e6aa tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.150335 Aug 30 02:09:42.389155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 422/857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:42 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:43.019822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:43.021047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:43.027605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:43.028113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:43.028546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:43.029248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:43.029773 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:43.033561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:43.164402 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:43.173281 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:43.174782 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:43.175946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ff6ddabe-2056-4b99-9adc-ac62bc1f3d18 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.161098 Aug 30 02:09:43.176740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 436/858] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:43 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:43.409112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:43.409780 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:43.416185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:43.416661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:43.417087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:43.417808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:43.418260 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:43.418675 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:43.553832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:43.561474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e5380eec-419b-4615-87d2-bc2556bd18b2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.156274 Aug 30 02:09:43.562621 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 423/859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:43 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:44.200924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:44.201857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:44.210083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:44.210810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:44.211310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:44.212269 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:44.213206 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:44.213892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:44.369055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:44.378886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:44.380847 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:44.382049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b80e780c-ec87-4e02-9158-2830987305b8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.186451 Aug 30 02:09:44.397753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 437/860] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:44 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:44.585572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:44.586809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:44.594963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:44.595448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:44.595876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:44.596578 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:44.597027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:44.597446 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:44.740362 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:44.748313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a71da793-b977-4b92-9dfa-6794e3e3b2f2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.167942 Aug 30 02:09:44.748886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 424/861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:44 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:45.406526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:45.407199 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:45.414412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:45.415153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:45.415743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:45.416652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:45.417256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:45.417856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:45.650263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:45.663250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:45.665108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:45.666534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a4b89b27-39d7-4103-98e6-4f1c3e8b3ccf tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.264362 Aug 30 02:09:45.667542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 438/862] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:45 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:45.770184 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:45.770827 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:45.777431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:45.778170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:45.778598 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:45.779290 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:45.779925 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:45.780918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:45.917400 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:45.926279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2cefc8c6-4741-4f10-970f-fe74c665fa33 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.159928 Aug 30 02:09:45.926855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 425/863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:45 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:46.687290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:46.692984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:46.700672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:46.700672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:46.701726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:46.711024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:46.711973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:46.712541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:46.713186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:46.881975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:46.893165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:46.894655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:46.895846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-54879eb1-8a04-44b7-bff9-9281a3d8c726 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.210056 Aug 30 02:09:46.896411 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 439/864] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:46 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:46.947788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:46.948701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:46.956376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:46.957044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:46.957506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:46.958215 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:46.958692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:46.959113 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:47.172958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:47.181335 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3631816c-777b-4c9c-9b5b-c4a8610caf27 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.237580 Aug 30 02:09:47.182257 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 426/865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:46 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:47.281884 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-c6c7d61d-c190-443a-833d-b18d93af5a8e req-14f2542a-3d54-4e73-a4f4-8ee735f517f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f61075-91c8-496b-9db8-bf335ed40b41", "name": "network-vif-plugged", "status": "completed", "tag": "8759456a-36e8-4421-a077-babbd546c544"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:47.298673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-c6c7d61d-c190-443a-833d-b18d93af5a8e req-14f2542a-3d54-4e73-a4f4-8ee735f517f6 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:47.299221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-c6c7d61d-c190-443a-833d-b18d93af5a8e req-14f2542a-3d54-4e73-a4f4-8ee735f517f6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:47.299728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-c6c7d61d-c190-443a-833d-b18d93af5a8e req-14f2542a-3d54-4e73-a4f4-8ee735f517f6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:47.314947 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-c6c7d61d-c190-443a-833d-b18d93af5a8e req-14f2542a-3d54-4e73-a4f4-8ee735f517f6 service nova] Creating event network-vif-plugged:8759456a-36e8-4421-a077-babbd546c544 for instance f3f61075-91c8-496b-9db8-bf335ed40b41 on hv-cinder-81966 Aug 30 02:09:47.320143 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-c6c7d61d-c190-443a-833d-b18d93af5a8e req-14f2542a-3d54-4e73-a4f4-8ee735f517f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042724 Aug 30 02:09:47.321128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 440/866] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:09:47.922291 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:47.922819 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:47.929982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:47.930500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:47.930953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:47.931839 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:47.932197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:47.932626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:48.070723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:48.080803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:48.082643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:48.086991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d92d1f98-f95f-4691-b3ab-e8ef79995aa4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.165958 Aug 30 02:09:48.086991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 427/867] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:47 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:48.206866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:48.207492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:48.209655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=10 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:48.215256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:48.215764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:48.216202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:48.216898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:48.217353 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:48.218876 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:48.354841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:48.363027 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-aab5cc7f-512f-4469-adb6-bf1d62f92ba4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.160406 Aug 30 02:09:48.363888 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 441/868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:48 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:49.108361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:49.110323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:49.113285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=40 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:49.118217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:49.118700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:49.119136 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:49.119830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:49.120314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:49.120736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:49.288116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:49.297207 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:49.299079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:49.300646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9252cedd-4571-40f3-8b04-99f43f435977 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.196098 Aug 30 02:09:49.301209 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 428/869] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:49 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:49.385029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:49.385954 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:49.393414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:49.394054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:49.394473 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:49.395177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:49.395627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:49.396049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:49.535495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:49.545959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-961518e5-54d4-4a57-a8b8-577b26f9adc3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.164746 Aug 30 02:09:49.557856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 442/870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:49 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:50.324322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:50.325156 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:50.331548 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:50.332037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:50.332471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:50.333170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:50.333664 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:50.334088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:50.498504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:50.508484 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:50.510265 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:50.511440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a9387c56-d9fd-4bf5-9db4-5a36c43ad618 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.191054 Aug 30 02:09:50.512165 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 429/871] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:50 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:50.570250 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:50.571053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:50.578844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:50.579424 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:50.579929 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:50.580673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:50.581128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:50.581580 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:50.728675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:50.737721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7b0fc51f-31ec-490f-90d2-e0ecb83c7f8a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.171055 Aug 30 02:09:50.738329 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 443/872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:50 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:51.536210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:51.536895 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:51.543719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:51.544229 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:51.544669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:51.545378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:51.545857 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:51.546453 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:51.690733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:51.700570 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:51.703203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:51.704404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cec47a69-989b-4acb-9a6b-5c0942562ce2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.172224 Aug 30 02:09:51.705046 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 430/873] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:51 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:51.759059 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:51.759673 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:51.766484 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:51.766976 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:51.767419 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:51.768125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:51.768587 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:51.769020 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:51.920267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:51.938756 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4c068981-35c5-4e43-b3be-1a09def5348e tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.183341 Aug 30 02:09:51.939620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 444/874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:51 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:52.727801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:52.728669 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:52.735432 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:52.735911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:52.736345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:52.737036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:52.737512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:52.737938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:52.867236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:52.876323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:52.877794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:52.878956 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-70293693-e1f6-4fd0-8a13-41f8b459dd03 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.155013 Aug 30 02:09:52.879519 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 431/875] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:52 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:52.960258 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:52.960863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:52.966903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:52.967377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:52.967803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:52.968726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:52.969137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:52.969582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:53.100955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:53.109290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-64affc54-107c-4a39-947c-c4083c347ab6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.152782 Aug 30 02:09:53.120254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 445/876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:52 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:53.902826 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:53.903450 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:53.910793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:53.911279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:53.911772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:53.912468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:53.912926 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:53.913355 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:54.047619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:54.056743 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:54.058183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:54.059335 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-537b45f2-3ff3-425d-a22c-6404a1ab21d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.160515 Aug 30 02:09:54.059893 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 432/877] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:53 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:54.129924 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:54.130734 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:54.137089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:54.137670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:54.138107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:54.138800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:54.139254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:54.139675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:54.271555 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:54.279490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-56eaa5bf-c312-4cd5-a8aa-680c12b512f0 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.153582 Aug 30 02:09:54.281157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 446/878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:54 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:55.082589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:55.083361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:55.089809 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:55.090322 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:55.090757 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:55.091452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:55.091905 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:55.092327 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:55.097055 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:55.233000 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:55.243468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:55.244898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:55.246168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c985e6a8-a6c1-4489-a65b-872c0034174d tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.167415 Aug 30 02:09:55.246710 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 433/879] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:55 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:55.301368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:55.302007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:55.308522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:55.309006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:55.309443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:55.310187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:55.310644 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:55.311072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:55.444886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:55.453514 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ef5e8d49-4f51-4098-92e9-157d1feadf9f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1314 microversion: 2.1 time: 0.156478 Aug 30 02:09:55.454251 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 447/880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:55 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:56.269341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:56.269993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:56.277440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:56.277958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:56.278739 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:56.279087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:56.279546 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:56.280006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:56.418855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:56.428503 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:56.429993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:56.431150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3a75601a-16f9-4976-8e8e-28fcbf95a5d8 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.166042 Aug 30 02:09:56.431709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 434/881] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:56 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:56.476292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:56.476901 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:56.484143 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:56.484658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:56.485125 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:56.485842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:56.486315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:56.486722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:56.502259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:09:56.614780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:56.622474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fdf8fff7-d11a-4ca3-8f51-fa4582e18ede tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1498 microversion: 2.1 time: 0.151441 Aug 30 02:09:56.623045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 448/882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:56 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:57.456123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:57.456743 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:57.463815 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:57.477494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:57.477494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:57.477494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:57.477494 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:57.478091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:57.521218 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:57.521898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:57.528463 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:57.529030 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:57.529572 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:57.533611 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:57.535126 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:57.535573 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:57.564224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:09:57.613488 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:57.621990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:57.623414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:57.625634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-574de8e2-ffed-41d0-bb29-7947b5d47be1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.174465 Aug 30 02:09:57.631920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 435/883] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:57 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:57.945626 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f1741ba8-3e84-4e3e-a272-408f862e9465 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 204 len: 0 microversion: 2.1 time: 0.427943 Aug 30 02:09:57.950298 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 449/884] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:09:57 2022] DELETE /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 02:09:57.955733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:57.956350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:57.966114 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:57.966700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:57.967155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:57.967866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:57.968351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:57.968744 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:58.099188 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:58.107136 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f71ae758-5485-40ea-b7e7-55684563714c tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1504 microversion: 2.1 time: 0.156627 Aug 30 02:09:58.107696 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 436/885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:57 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:58.652583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:58.653276 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:58.660349 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:58.660831 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:58.661256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:58.661972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:58.662416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:58.662834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:58.798374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:58.807033 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:58.808487 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:58.809687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-831ab16f-93f4-414e-92a7-1906ae86b213 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.163031 Aug 30 02:09:58.810308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 450/886] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:58 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:09:59.128902 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:59.129581 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:59.135984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:59.136463 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:59.136920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:59.137636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:59.138100 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:59.138533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:59.287203 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:09:59.294958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-defb83fe-bb8a-4caf-a049-3ca654634f5d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1504 microversion: 2.1 time: 0.170628 Aug 30 02:09:59.295526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 437/887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:09:59 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:09:59.832769 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:09:59.834358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:09:59.843157 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:59.843991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:59.844674 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:59.845992 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:59.846689 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:59.847330 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:59.850391 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-2643f464-77af-4af0-8880-a6aa7c4e2a3c req-f5548e54-c299-4174-9e67-7e4cb4eee05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f61075-91c8-496b-9db8-bf335ed40b41", "name": "network-vif-deleted", "tag": "8759456a-36e8-4421-a077-babbd546c544"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:09:59.860276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2643f464-77af-4af0-8880-a6aa7c4e2a3c req-f5548e54-c299-4174-9e67-7e4cb4eee05f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:09:59.860753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2643f464-77af-4af0-8880-a6aa7c4e2a3c req-f5548e54-c299-4174-9e67-7e4cb4eee05f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:09:59.861181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2643f464-77af-4af0-8880-a6aa7c4e2a3c req-f5548e54-c299-4174-9e67-7e4cb4eee05f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:09:59.876051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-2643f464-77af-4af0-8880-a6aa7c4e2a3c req-f5548e54-c299-4174-9e67-7e4cb4eee05f service nova] Creating event network-vif-deleted:8759456a-36e8-4421-a077-babbd546c544 for instance f3f61075-91c8-496b-9db8-bf335ed40b41 on hv-cinder-81966 Aug 30 02:09:59.887233 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-2643f464-77af-4af0-8880-a6aa7c4e2a3c req-f5548e54-c299-4174-9e67-7e4cb4eee05f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040516 Aug 30 02:09:59.888131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 438/888] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:09:59.998600 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:00.018187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:00.023115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:00.023115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c43496f0-1a2e-4f13-a763-60e8f5cc8e25 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.191958 Aug 30 02:10:00.023115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 451/889] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:09:59 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:00.318064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:00.318757 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:00.324883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:00.325390 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:00.325845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:00.326529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:00.326983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:00.327434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:00.397377 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:00.403503 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1e766952-321e-4c52-b794-b1a6a4d68dc8 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1462 microversion: 2.1 time: 0.090115 Aug 30 02:10:00.404137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 439/890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:00 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1462 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:01.045395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:01.046596 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:01.055220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:01.055710 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:01.056144 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:01.056849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:01.057302 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:01.057752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:01.240375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:01.253833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:01.255529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:01.256712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a530746f-2340-412f-abcf-1d32f4367b3b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.215415 Aug 30 02:10:01.257274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 452/891] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:01 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:10:01.427812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:01.428518 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:01.435173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:01.436879 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:01.436879 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:01.436879 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:01.437431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:01.437970 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:01.471402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:01.471881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:01.472315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:01.472758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lazy-loading 'fault' on Instance uuid f3f61075-91c8-496b-9db8-bf335ed40b41 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:10:01.512177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:01.521212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-605fb2db-1af7-4b3d-bbf5-d2300f2b6553 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 200 len: 1304 microversion: 2.1 time: 0.099538 Aug 30 02:10:01.521797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 440/892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:01 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:02.284262 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:02.284867 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:02.291319 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:02.291801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:02.292233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:02.292921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:02.293371 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:02.293817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:02.428416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:02.438058 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:02.439668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:02.440825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-632ec0a3-2270-422e-83b5-4faf1d9ab7e0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.160741 Aug 30 02:10:02.441493 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 453/893] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:02 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:02.543414 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:02.544357 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: f3f61075-91c8-496b-9db8-bf335ed40b41] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:02.551201 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:02.551723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:02.552210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:02.552891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:02.553347 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:02.553814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:02.567677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] HTTP exception thrown: Instance f3f61075-91c8-496b-9db8-bf335ed40b41 could not be found. Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Request method failure captured: Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 HTTP/1.1 Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXFdQMAdC48I1MQf98bTQTmX6-i8PQTmDrLdVNJMdWqLJZQL5MmgXcbHA1fJDereQQS5yVyoXcnx20KZkBm_5PF4HQxw-1SCYVaM3dMFQmWmK7JaUpTj8YDp2QYHkaLMVkd9G8Qw1MHRNVwk1F28M3nLwOU59ZjohtarYqCONJVNFkA Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: dbcd3b31535f46308cd1a15fd66538f0 Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-VolumesActionsTest-72007164 Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:10:02.569300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-VolumesActionsTest-72007164 Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: dbcd3b31535f46308cd1a15fd66538f0 Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-VolumesActionsTest-72007164 Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-VolumesActionsTest-72007164-project Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: ad16b4f1dfc94571bfcd4554ff588c86 Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-VolumesActionsTest-72007164-project Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance f3f61075-91c8-496b-9db8-bf335ed40b41 could not be found. Aug 30 02:10:02.570986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'f3f61075-91c8-496b-9db8-bf335ed40b41'} Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f61075-91c8-496b-9db8-bf335ed40b41 could not be found. Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:10:02.571961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f61075-91c8-496b-9db8-bf335ed40b41 could not be found. Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f61075-91c8-496b-9db8-bf335ed40b41 could not be found. Aug 30 02:10:02.573542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:02.574730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Returning 404 to user: Instance f3f61075-91c8-496b-9db8-bf335ed40b41 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:10:02.574730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a90a126e-7a2f-4a8f-9bb7-7f2fad5f5f97 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41" status: 404 len: 111 microversion: 2.1 time: 0.031100 Aug 30 02:10:02.574730 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 441/894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:02 2022] GET /compute/v2.1/servers/f3f61075-91c8-496b-9db8-bf335ed40b41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:10:02.624425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1500670726", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "networks": [{"uuid": "679b03cb-c332-4214-9386-ac405add0f6b"}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:02.678448 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] validate_networks() for [('679b03cb-c332-4214-9386-ac405add0f6b', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:10:03.039659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:10:03.040089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:10:03.040565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:10:03.041021 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:10:03.041608 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:10:03.053728 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:03.054491 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:03.055236 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:03.056450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:03.057134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:03.057599 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:03.076451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Getting quotas for project dbcd3b31535f46308cd1a15fd66538f0. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:10:03.083137 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Getting quotas for user ad16b4f1dfc94571bfcd4554ff588c86 and project dbcd3b31535f46308cd1a15fd66538f0. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:10:03.098152 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:10:03.100458 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:10:03.289716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1eb8cbd6-25ee-4592-bb49-e59ef74565d7 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669025 Aug 30 02:10:03.290632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 454/895] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:10:03.301612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1555c21a-1a54-44ed-826f-bd696da59447 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:03.302404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1555c21a-1a54-44ed-826f-bd696da59447 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:03.376935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1555c21a-1a54-44ed-826f-bd696da59447 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:03.384558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1555c21a-1a54-44ed-826f-bd696da59447 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1214 microversion: 2.1 time: 0.086773 Aug 30 02:10:03.385500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 442/896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:03 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:03.464349 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:03.468288 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:03.475415 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:03.476070 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:03.476736 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:03.477687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:03.478223 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:03.478986 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:03.608928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:03.617919 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:03.619482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:03.620655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9792cec7-d2c5-419a-ac37-f71ad5e19650 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.160861 Aug 30 02:10:03.621220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 455/897] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:03 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:04.406704 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:04.407342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:04.414487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:04.414972 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:04.415408 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:04.416097 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:04.416550 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:04.416974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:04.478528 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:04.486623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fc95e53b-fcd4-46a5-8154-9538684d862f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1218 microversion: 2.1 time: 0.084370 Aug 30 02:10:04.487175 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 443/898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:04 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:04.644383 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:04.645012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:04.648544 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:04.651886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:04.652357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:04.652789 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:04.653546 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:04.653998 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:04.654416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:04.790513 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:04.799950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:04.801388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:04.802604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a4e2db34-cf1e-4a61-b078-dde99dc7a5ae tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.162154 Aug 30 02:10:04.803170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 456/899] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:04 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:05.211422 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-32559af6-534a-4b8f-8661-3a6ca1b127a8 req-27ef0b50-c974-4c8c-9577-c33747e841aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "name": "network-vif-plugged", "status": "completed", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:05.221235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-32559af6-534a-4b8f-8661-3a6ca1b127a8 req-27ef0b50-c974-4c8c-9577-c33747e841aa service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:05.221873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-32559af6-534a-4b8f-8661-3a6ca1b127a8 req-27ef0b50-c974-4c8c-9577-c33747e841aa service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:05.222274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-32559af6-534a-4b8f-8661-3a6ca1b127a8 req-27ef0b50-c974-4c8c-9577-c33747e841aa service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:05.234301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-32559af6-534a-4b8f-8661-3a6ca1b127a8 req-27ef0b50-c974-4c8c-9577-c33747e841aa service nova] Creating event network-vif-plugged:fe64b060-7adc-4085-b29b-f081c84456b4 for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 on hv-cinder-81966 Aug 30 02:10:05.239356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-32559af6-534a-4b8f-8661-3a6ca1b127a8 req-27ef0b50-c974-4c8c-9577-c33747e841aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032094 Aug 30 02:10:05.240008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 444/900] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:05.507296 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:05.507903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:05.514012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:05.514496 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:05.514939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:05.515624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:05.516105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:05.516531 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:05.577221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:05.584879 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9cc61ecb-73d5-43bb-985a-e3fb5d76a634 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1266 microversion: 2.1 time: 0.081777 Aug 30 02:10:05.585442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 457/901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:05 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:05.827155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:05.827853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:05.834145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:05.834623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:05.835054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:05.835740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:05.836190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:05.836608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:05.967227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:05.976696 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:05.978079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:05.979483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-02a2b64c-7ea1-4a84-b097-f9cb07814994 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.157151 Aug 30 02:10:05.980037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 445/902] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:05 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:06.606911 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:06.607516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:06.614355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:06.614838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:06.615265 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:06.615951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:06.616538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:06.616816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:06.676727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:06.684246 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-75ae9ac5-68fc-46eb-b3a1-32ab8ebd4a6b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1266 microversion: 2.1 time: 0.081483 Aug 30 02:10:06.684801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 458/903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:06 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:07.006338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:07.006913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:07.013398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:07.013904 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:07.014332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:07.015011 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:07.015460 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:07.015876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:07.146528 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:07.155084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:07.157214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:07.158380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-493f7150-9abc-4768-aab1-dad4bc51376e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.156105 Aug 30 02:10:07.158932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 446/904] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:07 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:07.705275 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:07.705890 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:07.712401 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:07.712885 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:07.713318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:07.714050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:07.714509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:07.714930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:07.778547 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:07.787759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7f0e58ac-5061-4f57-951a-c8e760e82e3a tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1266 microversion: 2.1 time: 0.086904 Aug 30 02:10:07.788408 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 459/905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:07 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:08.182145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:08.182759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:08.189138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:08.189650 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:08.190076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:08.190762 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:08.191209 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:08.191624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:08.331563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:08.340103 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:08.347790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:08.347790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d0f9f90c-8d60-46ee-a854-5c6349769172 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.164486 Aug 30 02:10:08.347790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 447/906] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:08 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:10:08.808351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:08.808987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:08.816117 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:08.816714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:08.817149 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:08.817858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:08.818307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:08.818723 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:08.882873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:08.891439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-73ff782d-58c3-4fac-85c2-2b407af0010d tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1274 microversion: 2.1 time: 0.087037 Aug 30 02:10:08.892025 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 460/907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:08 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:09.366164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:09.366782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:09.373268 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:09.373802 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:09.374588 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:09.375496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:09.375958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:09.376383 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:09.587060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:09.595884 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:09.597323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:09.598544 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f1ab208a-c994-4d41-995a-0fa69f846a37 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.236292 Aug 30 02:10:09.599078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 448/908] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:09 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:10:09.915871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:09.916410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:09.923015 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:09.923495 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:09.923925 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:09.924612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:09.925183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:09.925570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:10.056755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:10.065182 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e5eac8a1-c002-424b-beb5-a9a3c6ca2da4 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.153207 Aug 30 02:10:10.065781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 461/909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:09 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:10.627190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:10.627807 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:10.634415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:10.635018 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:10.635457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:10.636150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:10.636633 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:10.637057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:10.771138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:10.780304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:10.782330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:10.783685 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-80fb08d1-dc6f-447d-8108-33fbfbe00375 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.160512 Aug 30 02:10:10.784569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 449/910] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:10 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:11.086283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:11.086896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:11.093818 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:11.094311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:11.094788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:11.095517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:11.095974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:11.096404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:11.182804 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-f9957f26-fb20-4abd-85c0-e6b753d23601 req-e859154c-4456-467d-891c-2859f9322e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201f14aa-d786-4903-8806-eca478c803e7", "tag": "32d98a86-69d2-4ed4-9d49-983f668129b7"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:11.196627 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-f9957f26-fb20-4abd-85c0-e6b753d23601 req-e859154c-4456-467d-891c-2859f9322e35 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:11.197120 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-f9957f26-fb20-4abd-85c0-e6b753d23601 req-e859154c-4456-467d-891c-2859f9322e35 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:11.197790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-f9957f26-fb20-4abd-85c0-e6b753d23601 req-e859154c-4456-467d-891c-2859f9322e35 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:11.211224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-f9957f26-fb20-4abd-85c0-e6b753d23601 req-e859154c-4456-467d-891c-2859f9322e35 service nova] Creating event network-changed:32d98a86-69d2-4ed4-9d49-983f668129b7 for instance 201f14aa-d786-4903-8806-eca478c803e7 on hv-cinder-81966 Aug 30 02:10:11.217068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-f9957f26-fb20-4abd-85c0-e6b753d23601 req-e859154c-4456-467d-891c-2859f9322e35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041009 Aug 30 02:10:11.218590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 450/911] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:11.240692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:11.259439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b916c1eb-7c6f-4369-954a-bb541853a0e2 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.176979 Aug 30 02:10:11.269507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 462/912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:11 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:11.809278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:11.809998 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:11.816625 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:11.817106 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:11.817560 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:11.818252 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:11.818700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:11.819117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:11.991073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:12.000856 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:12.002528 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:12.003651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-245ce9dc-bdeb-4fa2-a7f9-6f5d263030a2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1810 microversion: 2.20 time: 0.199237 Aug 30 02:10:12.004373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 451/913] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:11 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:12.282229 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:12.282755 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:12.289113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:12.289623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:12.290054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:12.290768 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:12.291341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:12.291664 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:12.427521 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:12.435215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c6f7d6cd-124d-4822-b071-16b180708742 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.157354 Aug 30 02:10:12.435775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 463/914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:12 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:13.038214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:13.038787 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:13.045214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:13.045736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:13.046195 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:13.046879 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:13.047360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:13.047782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:13.177979 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:13.186423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:13.188652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:13.189843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d78a2f04-2e3a-4738-898f-6d7e01ed7c1b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1797 microversion: 2.20 time: 0.155613 Aug 30 02:10:13.200639 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 452/915] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:13 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1797 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:13.512490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:13.513094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:13.515066 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:13.515753 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=6 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:13.521194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:13.521709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:13.522139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:13.522873 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:13.523325 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:13.523744 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:13.526310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:13.654558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:13.662789 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c900e5ff-e832-441d-8db8-56513536c78b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.154151 Aug 30 02:10:13.663355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 464/916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:13 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:14.684014 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:14.684623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:14.686580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:14.691789 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:14.692252 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:14.692686 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:14.693378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:14.693858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:14.694282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:14.698295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=100 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:14.827840 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:14.836525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a4b2c4a7-99f7-4897-9f94-2eedfaa91d3b tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.156265 Aug 30 02:10:14.837123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 453/917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:14 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:15.857905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:15.858522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:15.866305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:15.866792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:15.867223 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:15.867923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:15.868384 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:15.868801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:16.036729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:16.044432 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a3306541-0da0-4df4-9260-7cb6c504548f tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.190652 Aug 30 02:10:16.045070 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 465/918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:15 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:10:17.066276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:17.066898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:17.073436 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:17.073950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:17.074388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:17.075088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:17.075546 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:17.076066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:17.207969 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:17.215658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4547fec0-ca0c-4675-89a0-c29cb9831a44 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.154005 Aug 30 02:10:17.216610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 454/919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:17 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:17.464301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-7f013c39-5abf-4cc7-b9f1-9743d277550d req-a6633cd0-dbbb-47e8-8c71-ca4eb5218f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f14aa-d786-4903-8806-eca478c803e7", "name": "network-vif-plugged", "status": "completed", "tag": "32d98a86-69d2-4ed4-9d49-983f668129b7"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:17.475837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7f013c39-5abf-4cc7-b9f1-9743d277550d req-a6633cd0-dbbb-47e8-8c71-ca4eb5218f0d service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:17.475837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7f013c39-5abf-4cc7-b9f1-9743d277550d req-a6633cd0-dbbb-47e8-8c71-ca4eb5218f0d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:17.475837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-7f013c39-5abf-4cc7-b9f1-9743d277550d req-a6633cd0-dbbb-47e8-8c71-ca4eb5218f0d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:17.486846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-7f013c39-5abf-4cc7-b9f1-9743d277550d req-a6633cd0-dbbb-47e8-8c71-ca4eb5218f0d service nova] Creating event network-vif-plugged:32d98a86-69d2-4ed4-9d49-983f668129b7 for instance 201f14aa-d786-4903-8806-eca478c803e7 on hv-cinder-81966 Aug 30 02:10:17.491806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-7f013c39-5abf-4cc7-b9f1-9743d277550d req-a6633cd0-dbbb-47e8-8c71-ca4eb5218f0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031603 Aug 30 02:10:17.492389 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 466/920] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:18.241197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:18.242085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:18.249380 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:18.250183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:18.251201 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:18.251919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:18.252376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:18.252797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:18.383903 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:18.392396 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e1f58882-a45c-4414-8353-3696dd8f6637 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1314 microversion: 2.1 time: 0.154948 Aug 30 02:10:18.392955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 455/921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:18 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:19.415104 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:19.415921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:19.422167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:19.422635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:19.423132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:19.423884 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:19.426085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:19.426541 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:19.790254 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:19.798631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-05d4a907-27e3-45cf-ba0f-fca701690227 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1497 microversion: 2.1 time: 0.388263 Aug 30 02:10:19.799302 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 467/922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:19 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1497 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:20.727932 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:20.728434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:20.731075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=60 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:20.736306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:20.736810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:20.737254 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:20.738051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:20.738510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:20.738935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:20.763811 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Going to try to terminate instance {{(pid=121093) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:10:21.057168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-305aa0a3-e7fc-4a63-b684-0d306b98e507 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "DELETE /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 204 len: 0 microversion: 2.1 time: 0.332784 Aug 30 02:10:21.057858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 456/923] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:10:20 2022] DELETE /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:10:21.066447 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:21.067082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:21.073509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:21.073994 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:21.074426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:21.075112 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:21.075568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:21.075989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:21.210041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:21.217672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b75d2e4d-335d-47df-ab1e-687395b98fd3 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1503 microversion: 2.1 time: 0.155539 Aug 30 02:10:21.218233 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 468/924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:21 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:22.240224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:22.240954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:22.247378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:22.247858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:22.248283 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:22.248963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:22.249410 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:22.249852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:22.382360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:22.390069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0505b95c-a7a5-440d-886c-3611d3a25940 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1503 microversion: 2.1 time: 0.154181 Aug 30 02:10:22.390635 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 457/925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:22 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:22.948561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-637a8a83-3d3f-4e29-a276-5901b3bfec98 req-1bb0633a-9728-4c60-8814-aa8a53e041b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201f14aa-d786-4903-8806-eca478c803e7", "name": "network-vif-deleted", "tag": "32d98a86-69d2-4ed4-9d49-983f668129b7"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:22.963614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-637a8a83-3d3f-4e29-a276-5901b3bfec98 req-1bb0633a-9728-4c60-8814-aa8a53e041b9 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:22.964307 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-637a8a83-3d3f-4e29-a276-5901b3bfec98 req-1bb0633a-9728-4c60-8814-aa8a53e041b9 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:22.964950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-637a8a83-3d3f-4e29-a276-5901b3bfec98 req-1bb0633a-9728-4c60-8814-aa8a53e041b9 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:22.981244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-637a8a83-3d3f-4e29-a276-5901b3bfec98 req-1bb0633a-9728-4c60-8814-aa8a53e041b9 service nova] Creating event network-vif-deleted:32d98a86-69d2-4ed4-9d49-983f668129b7 for instance 201f14aa-d786-4903-8806-eca478c803e7 on hv-cinder-81966 Aug 30 02:10:22.987767 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-637a8a83-3d3f-4e29-a276-5901b3bfec98 req-1bb0633a-9728-4c60-8814-aa8a53e041b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044130 Aug 30 02:10:22.988399 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 469/926] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:23.411501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:23.412115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:23.418454 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:23.418936 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:23.419370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:23.420064 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:23.420520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:23.420944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:23.455605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:23.456082 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:23.456545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:23.456961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lazy-loading 'fault' on Instance uuid 201f14aa-d786-4903-8806-eca478c803e7 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:10:23.500100 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad16b4f1dfc94571bfcd4554ff588c86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcd3b31535f46308cd1a15fd66538f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:23.512883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-97526369-0987-4f4c-8260-f0807bb012d6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 200 len: 1304 microversion: 2.1 time: 0.100997 Aug 30 02:10:23.512883 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 458/927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:23 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:24.530372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:24.531080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] [instance: 201f14aa-d786-4903-8806-eca478c803e7] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:24.537930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:24.538416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:24.538858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:24.539543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:24.540068 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:24.540571 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:24.555161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] HTTP exception thrown: Instance 201f14aa-d786-4903-8806-eca478c803e7 could not be found. Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Request method failure captured: Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 HTTP/1.1 Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXFdQMAdC48I1MQf98bTQTmX6-i8PQTmDrLdVNJMdWqLJZQL5MmgXcbHA1fJDereQQS5yVyoXcnx20KZkBm_5PF4HQxw-1SCYVaM3dMFQmWmK7JaUpTj8YDp2QYHkaLMVkd9G8Qw1MHRNVwk1F28M3nLwOU59ZjohtarYqCONJVNFkA Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: dbcd3b31535f46308cd1a15fd66538f0 Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-VolumesActionsTest-72007164 Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:10:24.556805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dbcd3b31535f46308cd1a15fd66538f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-VolumesActionsTest-72007164 Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: dbcd3b31535f46308cd1a15fd66538f0 Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-VolumesActionsTest-72007164 Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-VolumesActionsTest-72007164-project Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: ad16b4f1dfc94571bfcd4554ff588c86 Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-VolumesActionsTest-72007164-project Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 201f14aa-d786-4903-8806-eca478c803e7 could not be found. Aug 30 02:10:24.558799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '201f14aa-d786-4903-8806-eca478c803e7'} Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201f14aa-d786-4903-8806-eca478c803e7 could not be found. Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:10:24.559965 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201f14aa-d786-4903-8806-eca478c803e7 could not be found. Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201f14aa-d786-4903-8806-eca478c803e7 could not be found. Aug 30 02:10:24.561443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:10:24.563331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] Returning 404 to user: Instance 201f14aa-d786-4903-8806-eca478c803e7 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:10:24.563331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9b8f804f-69e5-45a3-9905-cc29ada093f6 tempest-VolumesActionsTest-72007164 tempest-VolumesActionsTest-72007164-project] 10.222.0.27 "GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7" status: 404 len: 111 microversion: 2.1 time: 0.032822 Aug 30 02:10:24.563331 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 470/928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:10:24 2022] GET /compute/v2.1/servers/201f14aa-d786-4903-8806-eca478c803e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:10:46.113956 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:46.115124 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:46.117512 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:46.118138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:46.119155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:10:46.122210 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Tue Aug 30 02:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments/af6a36ab-8913-4738-9d61-d257e8c96fa5 (ip 10.222.0.27) !!! Aug 30 02:10:46.126048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:46.127404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:46.127941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:46.128643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:46.129118 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:46.129562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:46.161511 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-713aaf4b-4380-4ae8-8404-e0916f3082ee tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments/af6a36ab-8913-4738-9d61-d257e8c96fa5" status: 200 len: 194 microversion: 2.20 time: 0.051616 Aug 30 02:10:46.162115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 459/929] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Aug 30 02:10:46 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments/af6a36ab-8913-4738-9d61-d257e8c96fa5 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:10:46.229762 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:46.233994 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:46.233994 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=28 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:46.233994 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=29 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:10:46.239013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:46.239498 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:46.239943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:46.240634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:46.241092 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:46.241536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:46.323565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lazy-loading 'services' on Instance uuid 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:10:46.545083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2e9f78bb-833c-408a-a098-2da8671517d3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments/af6a36ab-8913-4738-9d61-d257e8c96fa5" status: 202 len: 0 microversion: 2.20 time: 0.319111 Aug 30 02:10:46.545862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 471/930] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 30 02:10:46 2022] DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments/af6a36ab-8913-4738-9d61-d257e8c96fa5 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:10:46.556680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:46.558967 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:46.567496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:46.567983 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:46.568417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:46.569313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:46.569825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:46.570246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:46.619521 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c50de83c-d1b2-4e1f-b2b5-5f6e50355930 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067785 Aug 30 02:10:46.620091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 460/931] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 02:10:46 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:10:47.639669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:47.644094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:47.653618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:47.654346 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:47.654912 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:47.655848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:47.656426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:47.657152 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:47.696047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-cc08fa77-1107-43ed-8794-2188617bb921 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066027 Aug 30 02:10:47.703083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 472/932] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 02:10:47 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:10:47.763634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:47.764131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:47.776665 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:47.777163 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:47.777690 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:47.778419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:47.778881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:47.779336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:47.807135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Going to try to terminate instance {{(pid=121093) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:10:48.136270 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c6a9d3e6-2ae4-4e09-881c-3badc2cea0c6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 204 len: 0 microversion: 2.20 time: 0.376212 Aug 30 02:10:48.136855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 461/933] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 02:10:47 2022] DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 02:10:48.145969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:48.146578 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:48.152800 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:48.153423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:48.153944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:48.154718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:48.155177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:48.155603 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:48.289987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:48.298154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:48.300253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:48.301434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ca4f87be-89cd-473e-a85b-31f764e8e9d0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.160273 Aug 30 02:10:48.302018 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 473/934] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:48 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:10:49.324935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:49.325717 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:49.332919 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:49.333186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:49.333659 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:49.334350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:49.334878 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:49.335245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:49.502448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:49.511222 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:49.514783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:49.514783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0e8d2ef2-39da-4df7-b733-0807965fb800 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1725 microversion: 2.20 time: 0.193856 Aug 30 02:10:49.514783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 462/935] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:49 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:50.538989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:50.539636 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:50.546410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:50.546893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:50.547326 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:50.548065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:50.549180 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:50.549632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:50.613207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:50.622945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:50.625192 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:50.627516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3225b83f-7093-4607-bca4-171d5978d2b1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1657 microversion: 2.20 time: 0.092312 Aug 30 02:10:50.628203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 474/936] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:50 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:10:50.680788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-98ba94da-6a14-47fb-9b8f-b88ca3eb82ac req-31747b63-8840-49b0-9b30-cefb5e3e2da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba259a7-78bc-4133-88dc-6c4724cc3ec9", "name": "network-vif-deleted", "tag": "fe64b060-7adc-4085-b29b-f081c84456b4"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:50.692821 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-98ba94da-6a14-47fb-9b8f-b88ca3eb82ac req-31747b63-8840-49b0-9b30-cefb5e3e2da2 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:50.693661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-98ba94da-6a14-47fb-9b8f-b88ca3eb82ac req-31747b63-8840-49b0-9b30-cefb5e3e2da2 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:50.694309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-98ba94da-6a14-47fb-9b8f-b88ca3eb82ac req-31747b63-8840-49b0-9b30-cefb5e3e2da2 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:50.707557 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-98ba94da-6a14-47fb-9b8f-b88ca3eb82ac req-31747b63-8840-49b0-9b30-cefb5e3e2da2 service nova] Creating event network-vif-deleted:fe64b060-7adc-4085-b29b-f081c84456b4 for instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 on hv-cinder-81966 Aug 30 02:10:50.714873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-98ba94da-6a14-47fb-9b8f-b88ca3eb82ac req-31747b63-8840-49b0-9b30-cefb5e3e2da2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038030 Aug 30 02:10:50.716376 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 463/937] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:10:51.654058 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:51.655711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:51.665618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:51.665618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:51.665804 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:51.666632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:51.667163 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:51.667658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:51.702347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:51.702828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:51.703263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:51.703853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lazy-loading 'fault' on Instance uuid 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:10:51.759253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:51.769360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:51.770985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:51.773718 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-861c7e12-39bb-4315-9b72-945690c1b9b5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 200 len: 1371 microversion: 2.20 time: 0.125100 Aug 30 02:10:51.774780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 475/938] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:51 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:52.797405 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:52.798249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:52.805038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:52.805646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:52.806083 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:52.806779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:52.807234 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:52.807658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:52.820976 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] HTTP exception thrown: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Request method failure captured: Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 HTTP/1.1 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXD68XbvyE8BS81tJh_FVxtPetfI7dE3liduTJdmoseg4QixaAu-tYzR6r3ZW-Lk1tnimrv_zLQJ1k2pIXY7NJA4whnNavAaU9w6AOktvFGV3HF-jBbWTMCcC5n9Iqi1gn2Vwligr7oRL6idLnnYDT5QNGh-We7JefmXU-fXc2tD-Wc Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:10:52.822612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 3eb33b1b787447daa68b651f9686574a Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:10:52.824328 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '8ba259a7-78bc-4133-88dc-6c4724cc3ec9'} Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:10:52.828556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:10:52.830458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:10:52.831887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Returning 404 to user: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:10:52.831887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-41ad5732-c889-40c9-ad2e-658a6af7000b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 404 len: 111 microversion: 2.20 time: 0.031556 Aug 30 02:10:52.831887 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 464/939] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:52 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:10:52.837349 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-42b19ab8-c200-4e94-ad97-ea5bcdc5a72c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '.version_select at 0x7f47364e25e0>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:52.946526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-42b19ab8-c200-4e94-ad97-ea5bcdc5a72c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029931658" status: 204 len: 0 microversion: 2.20 time: 0.113654 Aug 30 02:10:52.947503 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 476/940] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 02:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029931658 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 02:10:53.848897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-34b6387e-6e39-4b1e-a1d3-507afc99d8bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'create', calling method: .version_select at 0x7f47363fdee0>, body: {"keypair": {"name": "tempest-keypair-1721879125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZOZ+YbSyyFZAVAnII1J1DtISNKr/OWtSdsJLyHhtVaN4LKIndkbXc6DTibcyh+eE3J5FsD4I+M7MJg7NKfEH1EDP2J9j4n+ZPPgwQ8w4c/rgniTWdULsYQqYadQjbVhQ=="}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:53.865540 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-34b6387e-6e39-4b1e-a1d3-507afc99d8bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for project abe39137b275484ea6dafbed8d826eb3. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:10:53.869301 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-34b6387e-6e39-4b1e-a1d3-507afc99d8bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for user 3eb33b1b787447daa68b651f9686574a and project abe39137b275484ea6dafbed8d826eb3. Resources: {'key_pairs'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:10:53.978674 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-34b6387e-6e39-4b1e-a1d3-507afc99d8bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.134435 Aug 30 02:10:53.979569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 465/941] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 02:10:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 02:10:56.711465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1873752459", "imageRef": "5b25d6a9-61fc-4b05-a775-e6dc6e30cc36", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb8beefb-67a8-4456-8962-31eb3e214427"}], "security_groups": [{"name": "tempest-securitygroup--1376421014"}], "key_name": "tempest-keypair-1721879125", "user_data": "}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:10:56.830910 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] validate_networks() for [('cb8beefb-67a8-4456-8962-31eb3e214427', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:10:57.295465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:10:57.301970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:10:57.301970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:10:57.301970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:10:57.301970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:10:57.307957 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:57.308721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:57.309162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:57.309922 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:57.310601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:57.311224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:57.335466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for project abe39137b275484ea6dafbed8d826eb3. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:10:57.343929 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Getting quotas for user 3eb33b1b787447daa68b651f9686574a and project abe39137b275484ea6dafbed8d826eb3. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:10:57.359173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:10:57.363676 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5b25d6a9-61fc-4b05-a775-e6dc6e30cc36',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:10:57.543427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d22392ec-8182-46b0-9fe1-c2b3488255fb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.836498 Aug 30 02:10:57.544084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 477/942] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 02:10:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 02:10:57.557699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3bd9c39f-e716-466c-b795-ae30c28dedd3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:57.558604 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3bd9c39f-e716-466c-b795-ae30c28dedd3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:57.691138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3bd9c39f-e716-466c-b795-ae30c28dedd3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:57.715695 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3bd9c39f-e716-466c-b795-ae30c28dedd3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:57.726429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3bd9c39f-e716-466c-b795-ae30c28dedd3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:57.727612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3bd9c39f-e716-466c-b795-ae30c28dedd3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1282 microversion: 2.20 time: 0.175648 Aug 30 02:10:57.737708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 466/943] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:57 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:10:58.756663 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:58.757274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:58.764701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:58.765391 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:58.766128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:58.767011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:58.767460 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:58.768065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:58.831999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:58.840658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:58.842318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:10:58.843438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dc1b1e33-8d45-4763-8bc1-dd6e40274758 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1286 microversion: 2.20 time: 0.093766 Aug 30 02:10:58.850151 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 478/944] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:58 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:10:59.867415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:10:59.868060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:10:59.875792 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:59.876803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:59.887815 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:10:59.900662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:10:59.901701 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:10:59.902371 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:00.021017 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:00.051614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:00.055569 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:00.061777 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-93e3bc08-9ef3-4a48-95e9-5315196a8bac tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1342 microversion: 2.20 time: 0.198366 Aug 30 02:11:00.069100 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 467/945] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:10:59 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:01.100691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:01.101380 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:01.108400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:01.108886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:01.113357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:01.113357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:01.127653 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:01.128590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:01.517775 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:01.550861 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:01.553197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:01.558221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4ccf24f6-8950-4f4c-afcd-e7ddfebf0c72 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.461214 Aug 30 02:11:01.559359 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 479/946] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:01 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:02.597715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:02.600135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:02.614571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.615165 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.615683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.616718 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.618243 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.618899 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.696759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-04df12de-2dba-44b4-8dd8-9a99e6da3678 req-7023271b-726f-4bc6-85f4-6cfa8f62c92b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:02.741353 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-04df12de-2dba-44b4-8dd8-9a99e6da3678 req-7023271b-726f-4bc6-85f4-6cfa8f62c92b service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:02.741990 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-04df12de-2dba-44b4-8dd8-9a99e6da3678 req-7023271b-726f-4bc6-85f4-6cfa8f62c92b service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:02.742699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-04df12de-2dba-44b4-8dd8-9a99e6da3678 req-7023271b-726f-4bc6-85f4-6cfa8f62c92b service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:02.761618 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-04df12de-2dba-44b4-8dd8-9a99e6da3678 req-7023271b-726f-4bc6-85f4-6cfa8f62c92b service nova] Creating event network-changed:18104247-2f12-4918-9925-b466d738ce69 for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 on hv-cinder-81966 Aug 30 02:11:02.769320 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-04df12de-2dba-44b4-8dd8-9a99e6da3678 req-7023271b-726f-4bc6-85f4-6cfa8f62c92b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076973 Aug 30 02:11:02.770191 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 480/947] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:02.931872 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:02.942498 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:02.944081 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:02.945285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cd3e5634-cff2-44e4-8fbb-706195fa98d6 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.362568 Aug 30 02:11:02.946239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 468/948] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:02 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:03.969491 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:03.970608 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:03.977770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:03.978334 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:03.979006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:03.979829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:03.980545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:03.981333 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:04.234615 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:04.246371 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:04.252716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:04.252716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1aa22051-f00c-4d65-a2cf-8effa49555f3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.284626 Aug 30 02:11:04.252716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 481/949] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:03 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:05.273424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:05.274143 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:05.281886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.282433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.282953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.283971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:05.284610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:05.285205 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:05.457749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:05.467606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:05.469049 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:05.470905 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8fc514c4-ef63-49e2-83f9-f9fd45432412 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.201033 Aug 30 02:11:05.483697 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 469/950] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:05 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:06.193298 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6b23c928-c8e3-4c71-b6c1-49869784dd9d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Action: 'create', calling method: .version_select at 0x7f47364520d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1822245242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlVMyjyJg/rYH89DEsOAtbmbW9KMXpHKd/9KQgpj7HfMte9ZgpmWXdrqXijHkdi+sVS3+ziVW3GyQBYQJtJ51Xei9moBCndBRUDYfZ/Hu3KttOenk3/g2S65gkTNM0tuA=="}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:06.211222 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-6b23c928-c8e3-4c71-b6c1-49869784dd9d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for project fa2e7ced1148461faedcd0e1856bae95. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:11:06.219021 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-6b23c928-c8e3-4c71-b6c1-49869784dd9d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for user 40e0086c1b924e7f86bd814bb45be3d9 and project fa2e7ced1148461faedcd0e1856bae95. Resources: {'key_pairs'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:11:06.319025 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6b23c928-c8e3-4c71-b6c1-49869784dd9d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.357832 Aug 30 02:11:06.319733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 482/951] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 02:11:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:06.494597 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:06.495237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:06.501530 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:06.502053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:06.502527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:06.503229 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:06.503680 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:06.504108 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:06.635329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:06.644067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:06.645502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:06.646616 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f35fe083-c03a-41f2-8f15-b93460cd8596 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.155922 Aug 30 02:11:06.647241 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 470/952] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:06 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:07.603121 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:07.609711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-00e48469-373c-42fc-8478-2f337c88911a req-ef4cebeb-dacc-4b78-a142-b0f2bff160d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "name": "network-vif-plugged", "status": "completed", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:07.620518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-00e48469-373c-42fc-8478-2f337c88911a req-ef4cebeb-dacc-4b78-a142-b0f2bff160d8 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:07.620989 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-00e48469-373c-42fc-8478-2f337c88911a req-ef4cebeb-dacc-4b78-a142-b0f2bff160d8 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:07.621413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-00e48469-373c-42fc-8478-2f337c88911a req-ef4cebeb-dacc-4b78-a142-b0f2bff160d8 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:07.633414 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-00e48469-373c-42fc-8478-2f337c88911a req-ef4cebeb-dacc-4b78-a142-b0f2bff160d8 service nova] Creating event network-vif-plugged:18104247-2f12-4918-9925-b466d738ce69 for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 on hv-cinder-81966 Aug 30 02:11:07.638747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-00e48469-373c-42fc-8478-2f337c88911a req-ef4cebeb-dacc-4b78-a142-b0f2bff160d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036724 Aug 30 02:11:07.641798 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 483/953] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:07.672135 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:07.676911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:07.682398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:07.683278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:07.683903 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:07.684805 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:07.685261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:07.685768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:07.711981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=6 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:07.854166 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:07.868075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:07.877779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:07.877779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-92cfac48-d2f5-49a5-9c0c-662ad6e11fb2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.210797 Aug 30 02:11:07.877779 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 471/954] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:07 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:08.901309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:08.902573 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:08.912730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:08.912730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:08.912730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:08.912730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:08.913082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:08.913082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:09.115889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:09.125003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:09.126856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:09.128633 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-20ce2bfa-659a-4de7-b3b8-0b58bc5205a9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1408 microversion: 2.20 time: 0.232089 Aug 30 02:11:09.141506 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 484/955] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:08 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:10.152513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:10.155580 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:10.164161 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:10.165032 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:10.165699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:10.166647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:10.167315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:10.167921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:10.320342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:10.328931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:10.331189 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:10.332463 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7070319a-6f7c-47e3-8fb9-d04c00cf1fdd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1600 microversion: 2.20 time: 0.184129 Aug 30 02:11:10.333315 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 472/956] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:10 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1600 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:11:10.355110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:10.355913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:10.362706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:10.363212 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:10.363642 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:10.364332 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:10.364783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:10.365201 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:10.445315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-141874a1-64fa-408b-89f9-53c2d2c55fe7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094134 Aug 30 02:11:10.445941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 485/957] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 02:11:10 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:11:11.751392 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-5730d9e7-d35f-47df-afbf-4495aacec42d req-3c6b2c61-307b-4875-bbc1-0f7125a69802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:11.761993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-5730d9e7-d35f-47df-afbf-4495aacec42d req-3c6b2c61-307b-4875-bbc1-0f7125a69802 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:11.762662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-5730d9e7-d35f-47df-afbf-4495aacec42d req-3c6b2c61-307b-4875-bbc1-0f7125a69802 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:11.763190 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-5730d9e7-d35f-47df-afbf-4495aacec42d req-3c6b2c61-307b-4875-bbc1-0f7125a69802 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:11.776157 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-5730d9e7-d35f-47df-afbf-4495aacec42d req-3c6b2c61-307b-4875-bbc1-0f7125a69802 service nova] Creating event network-changed:18104247-2f12-4918-9925-b466d738ce69 for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 on hv-cinder-81966 Aug 30 02:11:11.781576 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-5730d9e7-d35f-47df-afbf-4495aacec42d req-3c6b2c61-307b-4875-bbc1-0f7125a69802 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Aug 30 02:11:11.785658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 473/958] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:13.608069 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:13.608628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:13.614791 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:13.615565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:13.616007 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:13.616706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:13.617166 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:13.617632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:13.642825 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lazy-loading 'flavor' on Instance uuid 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:11:13.932771 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4579d8f7-447f-449c-a1ac-052b260ea20e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "POST /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8/action" status: 202 len: 0 microversion: 2.1 time: 0.328380 Aug 30 02:11:13.934363 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 486/959] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:11:13 2022] POST /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:11:13.943496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:13.944188 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:13.952303 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:13.956889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:13.956889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:13.956889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:13.956889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:13.957559 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:14.106141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:14.113968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f0d3b600-6143-4af6-ac05-3732792dcb56 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.174950 Aug 30 02:11:14.114592 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 474/960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:13 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:15.140093 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:15.140816 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:15.148089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:15.148582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:15.149003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:15.149733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:15.150186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:15.150606 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:15.297520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:15.304013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-70fb75fb-1b1d-4029-aa69-083d5f0931d0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.171376 Aug 30 02:11:15.304589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 487/961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:15 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:11:16.324785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:16.325394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:16.331829 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:16.332309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:16.332745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:16.333431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:16.333906 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:16.334358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:16.464470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:16.472908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-78d6d0d6-2c2a-4384-81e7-48f441c3e756 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.151982 Aug 30 02:11:16.473489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 475/962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:16 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:17.495181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:17.501936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:17.502839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=10 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:17.503995 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:17.505434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:17.506002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:17.506465 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:17.507194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:17.507655 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:17.508085 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:17.512545 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:17.643904 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:17.651880 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ab069e9d-3475-4ed3-b121-919fee6bf953 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.161222 Aug 30 02:11:17.652492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 488/963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:17 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:18.673079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:18.673824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:18.676468 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:18.681349 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:18.681868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:18.682332 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:18.683088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:18.683492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:18.683911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:18.687899 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:18.813993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:18.821657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3d3050cc-95fd-4df1-a3cf-120ff6485990 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.152617 Aug 30 02:11:18.822215 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 476/964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:18 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:19.844002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:19.844610 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:19.852065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:19.852539 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:19.852964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:19.853670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:19.854120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:19.854537 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:19.996836 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:20.004620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-873b0722-4f4e-44d9-968b-6938d41c8bdf tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.164814 Aug 30 02:11:20.005163 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 489/965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:19 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:21.027461 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:21.027991 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:21.034476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:21.034946 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:21.035368 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:21.036048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:21.036496 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:21.036912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:21.170389 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:21.179346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c489deee-7661-49af-88bd-27b54c8a280e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.156148 Aug 30 02:11:21.185995 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 477/966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:21 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:22.204362 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:22.204975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:22.211743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:22.212223 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:22.212658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:22.213349 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:22.213830 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:22.214256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:22.342550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:22.350821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b96d8b68-6c60-4b7a-b463-84963c22a582 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.150234 Aug 30 02:11:22.351315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 490/967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:22 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:11:23.372589 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:23.373196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:23.379758 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:23.380231 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:23.385226 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:23.385226 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:23.385226 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:23.385226 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:23.522622 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:23.531238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-04ca631a-c239-495a-b9b3-e5be18987ee8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.162752 Aug 30 02:11:23.531824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 478/968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:23 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:24.551970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:24.552774 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:24.560012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:24.560497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:24.560927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:24.561662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:24.562115 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:24.562586 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:24.645632 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1994892190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1822245242", "security_groups": [{"name": "tempest-secgroup-smoke-1411314915"}], "block_device_mapping_v2": [{"uuid": "beba143a-106e-4647-926e-6974cb8b6a55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b43df500-c05c-42ca-b288-93458deb45ab"}]}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:24.707333 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:24.716406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-242700be-7393-405d-9973-1e962edc2062 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.168200 Aug 30 02:11:24.717305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 491/969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:24 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:24.782345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] validate_networks() for [('b43df500-c05c-42ca-b288-93458deb45ab', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:11:25.147473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:11:25.147923 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:11:25.148401 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:11:25.148807 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:11:25.149221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:11:25.158043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:25.158527 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:25.158964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:25.159694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:25.160146 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:25.160574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:25.179066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for project fa2e7ced1148461faedcd0e1856bae95. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:11:25.183069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for user 40e0086c1b924e7f86bd814bb45be3d9 and project fa2e7ced1148461faedcd0e1856bae95. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:11:25.243820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:11:25.245986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='beba143a-106e-4647-926e-6974cb8b6a55',volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:11:25.735180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-22f1a0cf-cf70-4a59-b4e3-9f001cabbdef tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.093337 Aug 30 02:11:25.740361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 479/970] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:11:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 02:11:25.740502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:25.740502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:25.746796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-96a43b5a-5a54-4fcf-9c32-9b4c76a92df2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:25.747041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:25.747563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-96a43b5a-5a54-4fcf-9c32-9b4c76a92df2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:25.747759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:25.748240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:25.748934 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:25.749570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:25.749828 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:25.805423 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-96a43b5a-5a54-4fcf-9c32-9b4c76a92df2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:25.812891 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-96a43b5a-5a54-4fcf-9c32-9b4c76a92df2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1095 microversion: 2.1 time: 0.069977 Aug 30 02:11:25.813765 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 480/971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:25 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:11:25.895688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:25.903788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-74258459-68d8-4d9a-ae59-f96e48cf9bb1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.169171 Aug 30 02:11:25.904351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 492/972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:25 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:26.834577 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:26.835246 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:26.841803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:26.842309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:26.842745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:26.843443 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:26.843956 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:26.844306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:26.909325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:26.916992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3737433e-a6af-4b8a-90f6-4f327bcedf55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1145 microversion: 2.1 time: 0.086332 Aug 30 02:11:26.917581 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 481/973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:26 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:26.925170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:26.925861 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:26.932893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:26.933363 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:26.933823 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:26.934505 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:26.934962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:26.935379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:27.069261 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:27.077759 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-14c0f1d4-976e-40d2-9c4c-f5440b53bba1 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.156419 Aug 30 02:11:27.078334 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 493/974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:26 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:27.938448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:27.939077 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:27.946619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:27.947192 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:27.947628 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:27.948329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:27.948785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:27.949208 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.012736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:28.020452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-83951e70-cc0e-40e4-aa82-79d1da7fcad4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1193 microversion: 2.1 time: 0.086051 Aug 30 02:11:28.021020 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 482/975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:27 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:28.099754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:28.100400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:28.107313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:28.107804 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:28.108240 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.108941 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:28.109403 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:28.109866 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.245785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:28.253619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-29e8dfe9-f44d-4789-9c0b-8e2d37784091 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1510 microversion: 2.1 time: 0.157777 Aug 30 02:11:28.254387 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 494/976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:28 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:28.277890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:28.278486 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:28.284713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:28.285197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:28.285668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.286372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:28.286824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:28.287245 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.342326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121093) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 02:11:28.629882 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cdc8a4f5-8649-4bb7-bb08-10a6c21159c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "POST /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8/action" status: 202 len: 0 microversion: 2.1 time: 0.355902 Aug 30 02:11:28.630731 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 483/977] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 02:11:28 2022] POST /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:11:28.640666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:28.641133 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:28.647351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:28.647987 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:28.648534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.649839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:28.650480 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:28.650920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:28.815050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:28.824568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-920c2cab-6753-4747-b5a7-d0db47405296 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1518 microversion: 2.1 time: 0.187709 Aug 30 02:11:28.824568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 495/978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:28 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:29.044832 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:29.045768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:29.053034 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:29.053535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:29.054185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:29.054952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:29.055402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:29.055818 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:29.269506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:29.281732 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6e47bbc5-37b1-4c26-8471-c9b4cc4d49a9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1279 microversion: 2.1 time: 0.243439 Aug 30 02:11:29.283462 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 484/979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:29 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1279 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:29.611822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-704171b4-494f-492d-b691-c95686f3ff71 req-6dc00afa-9ece-4aad-940a-cda66c8c9ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "name": "network-vif-unplugged", "status": "completed", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:29.622898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-704171b4-494f-492d-b691-c95686f3ff71 req-6dc00afa-9ece-4aad-940a-cda66c8c9ca0 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:29.623573 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-704171b4-494f-492d-b691-c95686f3ff71 req-6dc00afa-9ece-4aad-940a-cda66c8c9ca0 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:29.624001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-704171b4-494f-492d-b691-c95686f3ff71 req-6dc00afa-9ece-4aad-940a-cda66c8c9ca0 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:29.637730 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.compute.server_external_events [req-704171b4-494f-492d-b691-c95686f3ff71 req-6dc00afa-9ece-4aad-940a-cda66c8c9ca0 service nova] Unable to find a host for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8. Dropping event network-vif-unplugged {{(pid=121094) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 02:11:29.638614 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-704171b4-494f-492d-b691-c95686f3ff71 req-6dc00afa-9ece-4aad-940a-cda66c8c9ca0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032745 Aug 30 02:11:29.639186 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 496/980] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 02:11:29.844145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:29.844770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:29.850740 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:29.851227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:29.852249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:29.853043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:29.853523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:29.853949 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:29.963175 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-af423de6-fa01-4a04-bd6b-1a2773f85d63 req-ddab644a-89bb-4da7-aba9-c3a5a038c717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1130974-c6cb-4808-9dce-76f961f71ac6", "tag": "794625df-3536-4bb3-a640-e90e2e2cd74e"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:29.973035 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-af423de6-fa01-4a04-bd6b-1a2773f85d63 req-ddab644a-89bb-4da7-aba9-c3a5a038c717 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:29.973583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-af423de6-fa01-4a04-bd6b-1a2773f85d63 req-ddab644a-89bb-4da7-aba9-c3a5a038c717 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:29.974117 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-af423de6-fa01-4a04-bd6b-1a2773f85d63 req-ddab644a-89bb-4da7-aba9-c3a5a038c717 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:29.986067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-af423de6-fa01-4a04-bd6b-1a2773f85d63 req-ddab644a-89bb-4da7-aba9-c3a5a038c717 service nova] Creating event network-changed:794625df-3536-4bb3-a640-e90e2e2cd74e for instance a1130974-c6cb-4808-9dce-76f961f71ac6 on hv-cinder-81966 Aug 30 02:11:29.991232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-af423de6-fa01-4a04-bd6b-1a2773f85d63 req-ddab644a-89bb-4da7-aba9-c3a5a038c717 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Aug 30 02:11:29.992570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 497/981] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:11:30.084440 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:30.092465 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-24979e3b-bb33-4579-9392-fe729eb98d48 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1520 microversion: 2.1 time: 0.252198 Aug 30 02:11:30.093037 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 485/982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:29 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:30.306962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:30.307882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:30.314526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:30.315041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:30.315805 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:30.316690 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:30.317142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:30.317821 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:30.457827 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:30.466365 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-719c3f81-6bb9-4cd6-89de-b685db125463 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.165774 Aug 30 02:11:30.466939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 498/983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:30 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:31.114402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:31.115013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:31.121604 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:31.122087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:31.122522 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:31.123213 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:31.123671 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:31.124096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:31.255449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:31.263803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-62c480af-e05a-4dbc-aea1-e8a283ca2c74 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.153286 Aug 30 02:11:31.264373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 486/984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:31 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:31.489102 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:31.489736 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:31.497682 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:31.498168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:31.498596 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:31.499288 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:31.499738 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:31.500154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:31.634398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:31.642264 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a3f260e2-dfad-4081-9993-2dfbe11c10a8 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.157762 Aug 30 02:11:31.642843 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 499/985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:31 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:32.284039 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:32.284650 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:32.291790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:32.292273 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:32.292707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:32.293398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:32.293881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:32.294304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:32.427897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:32.435796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-924a1ced-1834-4522-949c-ee85f7821b57 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.155601 Aug 30 02:11:32.436370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 487/986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:32 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:32.663237 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:32.663899 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:32.670518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:32.671023 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:32.671450 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:32.672129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:32.672579 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:32.672996 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:32.808154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:32.816065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2d0d7bfd-c5c2-4a8c-bc3d-4ce6a4074c30 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.156722 Aug 30 02:11:32.816627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 500/987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:32 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:33.457751 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:33.458372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:33.465425 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:33.465961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:33.466398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:33.467091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:33.467552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:33.467976 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:33.596053 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:33.604418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1306a1d3-e2ed-454f-90aa-3f5c3073fc45 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.150520 Aug 30 02:11:33.605501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 488/988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:33 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:33.837829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:33.838429 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:33.844732 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:33.845212 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:33.845678 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:33.846362 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:33.846870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:33.847292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:33.980510 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:33.988975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f8e0d231-c894-4b3c-9da7-a3930ca2cb55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.155644 Aug 30 02:11:33.989577 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 501/989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:33 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:34.626457 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:34.627062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:34.633353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:34.634142 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:34.634731 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:34.635413 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:34.635862 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:34.636279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:34.921351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:34.929136 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-82278ec3-824d-4aac-8d8e-1ae98cce694f tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.306576 Aug 30 02:11:34.931808 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 489/990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:34 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:35.010366 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:35.011004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:35.017436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:35.017946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:35.018395 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:35.019067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:35.019557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:35.019977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:35.154970 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:35.162592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6dc22b5b-0d45-4722-8cab-428bbb6d699b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.156482 Aug 30 02:11:35.163158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 502/991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:35 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:11:35.951636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:35.952505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:35.954409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:35.955197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=8 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:35.960490 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:35.972296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:35.972296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:35.972296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:35.972296 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:35.972716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:36.099057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:36.106986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d6145478-cf47-4a23-969f-a5c31ad76e7a tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.159792 Aug 30 02:11:36.107554 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 490/992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:35 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:36.184638 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:36.185301 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:36.191701 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:36.196543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:36.196543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:36.196543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:36.196543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:36.196953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:36.343607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:36.351286 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9bc75f41-c183-4eb2-9e5a-d7897400db4e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.171282 Aug 30 02:11:36.351849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 503/993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:36 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:37.128736 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:37.129346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:37.135892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:37.136365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:37.136797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:37.137502 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:37.137953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:37.138398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:37.268415 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:37.278098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e37a63e3-2588-486d-acd9-1358ce211ee0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.153316 Aug 30 02:11:37.278654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 491/994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:37 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:37.373094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:37.373729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:37.380170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:37.380590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:37.381025 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:37.381740 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:37.382189 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:37.382615 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:37.507926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:37.516205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fd69132f-2b2e-4d2f-ad92-f4f4e492d4bc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.147036 Aug 30 02:11:37.516769 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 504/995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:37 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:38.298892 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:38.299497 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:38.305886 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:38.306982 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:38.307388 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:38.308342 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:38.308871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:38.309295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:38.440604 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:38.448152 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7f23378e-44d2-4483-be9a-43942b1fd797 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.153208 Aug 30 02:11:38.448699 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 492/996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:38 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:38.536440 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:38.537050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:38.544119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:38.544605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:38.545040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:38.545765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:38.546225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:38.546651 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:38.683808 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:38.691693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-318c0ef3-e34f-4a08-811c-f7654eed001b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.158902 Aug 30 02:11:38.692274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 505/997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:38 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:39.468656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:39.469316 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:39.475727 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:39.476146 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:39.476571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:39.477250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:39.477724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:39.478173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:39.492535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:39.608643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:39.616350 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d9866871-bfba-4d0c-96ac-31aded08d217 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.151501 Aug 30 02:11:39.616911 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 493/998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:39 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:39.711561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:39.712172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:39.718783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:39.719492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:39.719936 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:39.720622 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:39.721083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:39.721534 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:39.725908 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=100 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:39.855835 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:39.863783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7fd5f9b1-00bf-4ab4-b6da-f9b310b1aaf1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.156173 Aug 30 02:11:39.864357 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 506/999] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:39 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:40.639202 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:40.640505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:40.649212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:40.649820 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:40.650227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:40.650938 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:40.651404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:40.651833 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:40.788700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:40.797051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c40cc20d-a262-45f7-8f76-a89a8a9cb585 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.163318 Aug 30 02:11:40.797634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 494/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:40 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:40.884590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:40.885417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:40.892169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:40.892731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:40.893169 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:40.893972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:40.894421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:40.894844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:41.030280 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:41.038224 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c4aa6494-cca0-49a6-af5d-f96e7d01072f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.157931 Aug 30 02:11:41.038975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 507/1001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:40 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:41.742444 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-596d992e-b3b7-4b9f-8626-b39dad724c80 req-596c9324-fc06-4744-80b3-45888199fd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "name": "network-vif-plugged", "status": "completed", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:41.752778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-596d992e-b3b7-4b9f-8626-b39dad724c80 req-596c9324-fc06-4744-80b3-45888199fd93 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:41.753248 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-596d992e-b3b7-4b9f-8626-b39dad724c80 req-596c9324-fc06-4744-80b3-45888199fd93 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:41.753692 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-596d992e-b3b7-4b9f-8626-b39dad724c80 req-596c9324-fc06-4744-80b3-45888199fd93 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:41.767099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-596d992e-b3b7-4b9f-8626-b39dad724c80 req-596c9324-fc06-4744-80b3-45888199fd93 service nova] Creating event network-vif-plugged:ad71926d-6c2f-4698-a7f2-9471cb54c167 for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 on hv-cinder-81966 Aug 30 02:11:41.772486 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-596d992e-b3b7-4b9f-8626-b39dad724c80 req-596c9324-fc06-4744-80b3-45888199fd93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033779 Aug 30 02:11:41.773059 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 495/1002] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:11:41.819314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:41.819953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:41.827006 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:41.827501 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:41.827933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:41.828638 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:41.829118 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:41.829572 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:41.965552 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:41.975581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-edb1ecb9-bc7f-4bb1-9799-dc5af24f5893 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.160336 Aug 30 02:11:41.976709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 508/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:41 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:42.063605 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:42.065274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:42.077176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:42.078012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:42.078788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:42.080373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:42.081080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:42.081907 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:42.228403 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:42.236836 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5417a5a8-9b53-476f-9986-9bb9dd78dda4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.180856 Aug 30 02:11:42.237416 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 496/1004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:42 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:42.997895 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:42.998433 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:43.004802 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:43.005284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:43.005754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:43.006455 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:43.006897 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:43.007320 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:43.144183 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:43.152973 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2ab90835-deeb-4168-98b2-00d1bf268ab8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1576 microversion: 2.1 time: 0.159130 Aug 30 02:11:43.153558 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 509/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:42 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:43.257421 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:43.257990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:43.265078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:43.265638 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:43.266074 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:43.266766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:43.267221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:43.267644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:43.400683 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:43.408969 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fd6a30d1-4280-4ac1-b83a-b619eba721cd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.155596 Aug 30 02:11:43.409586 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 497/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:43 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:43.787786 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-d948c1f8-7722-4332-9721-91d88a91cc6b req-b5beeedf-046f-47ff-897a-c56cdc8ebc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1130974-c6cb-4808-9dce-76f961f71ac6", "name": "network-vif-plugged", "status": "completed", "tag": "794625df-3536-4bb3-a640-e90e2e2cd74e"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:43.797764 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d948c1f8-7722-4332-9721-91d88a91cc6b req-b5beeedf-046f-47ff-897a-c56cdc8ebc1e service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:43.798241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d948c1f8-7722-4332-9721-91d88a91cc6b req-b5beeedf-046f-47ff-897a-c56cdc8ebc1e service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:43.798668 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-d948c1f8-7722-4332-9721-91d88a91cc6b req-b5beeedf-046f-47ff-897a-c56cdc8ebc1e service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:43.809984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-d948c1f8-7722-4332-9721-91d88a91cc6b req-b5beeedf-046f-47ff-897a-c56cdc8ebc1e service nova] Creating event network-vif-plugged:794625df-3536-4bb3-a640-e90e2e2cd74e for instance a1130974-c6cb-4808-9dce-76f961f71ac6 on hv-cinder-81966 Aug 30 02:11:43.814927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-d948c1f8-7722-4332-9721-91d88a91cc6b req-b5beeedf-046f-47ff-897a-c56cdc8ebc1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030839 Aug 30 02:11:43.815521 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 510/1007] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:11:44.174667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:44.175282 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:44.181642 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:44.182114 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:44.182601 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:44.183302 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:44.183806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:44.184232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:44.317963 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:44.326571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6ef8c8db-b9a3-49e1-a493-833c0a48d88e tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1563 microversion: 2.1 time: 0.155976 Aug 30 02:11:44.327139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 498/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:44 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:44.430751 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:44.431364 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:44.437479 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:44.437971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:44.438405 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:44.439097 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:44.439550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:44.439969 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:44.568765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:44.577159 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7609ef63-8355-46e1-bc29-3b46026ec22d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1267 microversion: 2.1 time: 0.151138 Aug 30 02:11:44.577768 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 511/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:44 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:45.599825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:45.600554 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:45.607988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:45.608469 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:45.608903 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:45.609633 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:45.610083 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:45.610504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:45.742015 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:45.749674 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b7530dfc-5e04-4989-bd68-9b0c479854a2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1454 microversion: 2.1 time: 0.155063 Aug 30 02:11:45.750235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 499/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:45 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:45.769985 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:45.770627 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:45.777604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:45.778084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:45.778518 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:45.779207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:45.779659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:45.780084 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:45.907891 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:45.915570 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fa829592-14c8-4159-a5ec-8ac15c266e85 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1454 microversion: 2.1 time: 0.149289 Aug 30 02:11:45.916129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 512/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:11:45 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:11:47.882178 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:47.883267 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:47.890602 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:47.891250 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:47.891894 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:47.892770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:47.893225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:47.893688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:47.918725 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-92979071-618e-4e00-933c-bf54fd1d0362 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/ips" status: 200 len: 152 microversion: 2.20 time: 0.040641 Aug 30 02:11:47.924230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 500/1012] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Aug 30 02:11:47 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:11:47.924360 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-f84f3a56-47ac-4f5c-9150-75c95e81e17d req-2fefbf4e-b3ae-4c79-a17e-71887774d815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1130974-c6cb-4808-9dce-76f961f71ac6", "tag": "794625df-3536-4bb3-a640-e90e2e2cd74e"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:47.933585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-f84f3a56-47ac-4f5c-9150-75c95e81e17d req-2fefbf4e-b3ae-4c79-a17e-71887774d815 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:47.934065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-f84f3a56-47ac-4f5c-9150-75c95e81e17d req-2fefbf4e-b3ae-4c79-a17e-71887774d815 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:47.934677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-f84f3a56-47ac-4f5c-9150-75c95e81e17d req-2fefbf4e-b3ae-4c79-a17e-71887774d815 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:47.946522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-f84f3a56-47ac-4f5c-9150-75c95e81e17d req-2fefbf4e-b3ae-4c79-a17e-71887774d815 service nova] Creating event network-changed:794625df-3536-4bb3-a640-e90e2e2cd74e for instance a1130974-c6cb-4808-9dce-76f961f71ac6 on hv-cinder-81966 Aug 30 02:11:47.952190 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-f84f3a56-47ac-4f5c-9150-75c95e81e17d req-2fefbf4e-b3ae-4c79-a17e-71887774d815 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033045 Aug 30 02:11:47.952962 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 513/1013] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:11:50.128060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:11:50.128654 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:50.131085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:50.135937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:50.136412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:50.136843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:50.137557 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:50.138007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:50.140487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:50.162505 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lazy-loading 'flavor' on Instance uuid 1a0e1ee8-ce44-49a5-b490-ab729c82e448 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:11:50.607960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3ac421bf-4e68-4687-a934-ccacfd6a637a tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/action" status: 202 len: 0 microversion: 2.20 time: 0.483812 Aug 30 02:11:50.608534 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 501/1014] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 02:11:50 2022] POST /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:11:50.617918 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:50.618586 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:50.621278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=52 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:11:50.626161 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:50.626646 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:50.627078 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:50.627772 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:50.628226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:50.628648 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:50.772040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:50.780400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:50.781889 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:50.783050 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ef131bc6-f0c1-4ab0-a659-06bd7a093cd1 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.169991 Aug 30 02:11:50.783617 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 514/1015] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:50 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:11:51.806825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:51.807655 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:51.813958 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:51.814442 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:51.819661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:51.819661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:51.819661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:51.819661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:51.950709 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:51.965771 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:51.967242 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:51.968437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-146a8c82-cb2e-4b52-93d7-f469131db0bb tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.166469 Aug 30 02:11:51.969005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 502/1016] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:51 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:52.993041 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:52.993604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:52.999726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:53.000196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:53.000622 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:53.001303 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:53.001799 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:53.002219 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:53.133971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:53.142333 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:53.143974 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:53.145117 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-357b80b6-6bad-4434-af98-b7b92e1aff56 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.156234 Aug 30 02:11:53.145716 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 515/1017] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:52 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:54.169658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:54.170266 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:54.176825 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:54.177299 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:54.177781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:54.178445 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:54.178890 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:54.179307 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:54.308854 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:54.316918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:54.318394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:54.319545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8a00b076-f87d-498e-a002-c15291fa1782 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.154591 Aug 30 02:11:54.320098 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 503/1018] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:54 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:55.344631 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:55.345234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:55.351662 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:55.352138 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:55.352569 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:55.353253 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:55.353824 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:55.355032 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:55.484456 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:55.492433 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:55.493930 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:55.495040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5880ff9f-a7c9-498c-9dc4-9a3f78642a64 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.154490 Aug 30 02:11:55.495598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 516/1019] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:55 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:11:56.517868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:56.518470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:56.524781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:56.525254 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:56.525706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:56.527088 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:56.527545 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:56.528196 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:56.657068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:56.664981 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:56.666513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:56.667878 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-60c4738c-64f0-4956-9172-d238fb6c6f12 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.153823 Aug 30 02:11:56.668486 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 504/1020] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:56 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:57.691033 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:57.691623 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:57.698231 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:57.698723 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:57.699154 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:57.699853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:57.700309 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:57.700732 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:57.831933 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:57.840536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:57.842008 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:57.843165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9ccd7929-6ea0-4186-b6c0-a61cae28d75b tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.156107 Aug 30 02:11:57.843723 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 517/1021] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:57 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:11:58.866627 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:11:58.867237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:11:58.874612 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:58.875297 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:58.875583 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:58.876266 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:11:58.876719 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:11:58.877197 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:11:59.057044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:59.066111 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:59.067549 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:11:59.068706 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f6f033f5-f8b3-4f4c-8e83-d869c587b838 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.206052 Aug 30 02:11:59.069255 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 505/1022] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:11:58 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:00.092027 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:00.092629 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:00.098959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:00.099431 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:00.099858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:00.100542 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:00.100995 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:00.101412 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:00.288230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:00.296765 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:00.298396 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:00.299550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bca25d96-eb0a-4d1d-884f-a0d526476bcd tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.211647 Aug 30 02:12:00.300107 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 518/1023] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:00 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:12:01.323623 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:01.324230 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:01.330646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:01.331130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:01.331560 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:01.332253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:01.332707 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:01.333131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:01.458072 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:01.466235 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:01.468694 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:01.469964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e645d776-1800-469a-b177-ae9177e270b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.150896 Aug 30 02:12:01.470521 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 506/1024] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:01 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:02.495158 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:02.495820 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:02.503677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:02.504167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:02.504607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:02.505398 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:02.505887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:02.506311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:02.658943 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:02.668602 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:02.670516 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:02.671714 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1603522b-2ab7-432e-b00d-f6f8b3157bf0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.181978 Aug 30 02:12:02.672295 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 519/1025] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:02 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:03.695474 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:03.696084 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:03.703052 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:03.703532 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:03.704151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:03.704844 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:03.705531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:03.705898 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:03.840693 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:03.848759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:03.850220 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:03.851409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9328f515-dec7-48bc-94ea-f3833b109372 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.160224 Aug 30 02:12:03.851961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 507/1026] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:03 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:04.875756 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:04.876362 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:04.882856 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:04.883339 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:04.883773 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:04.884467 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:04.884923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:04.885937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:05.014426 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:05.022420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:05.028162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:05.028162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-72e62690-652a-479d-a18b-44cd136211b0 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.153290 Aug 30 02:12:05.028162 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 520/1027] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:04 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:06.048331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:06.048940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:06.055039 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:06.055515 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:06.055944 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:06.056631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:06.057085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:06.057520 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:06.186066 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:06.194181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:06.195631 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:06.196772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cdb0123c-9758-4cc7-a1a1-4e1fbd5a6144 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.152745 Aug 30 02:12:06.197372 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 508/1028] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:06 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:07.220822 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:07.221425 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:07.227729 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:07.228263 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:07.228694 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:07.229374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:07.229857 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:07.230951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:07.361011 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:07.369100 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:07.370634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:07.371803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-704ea99f-54bd-4f40-9d91-80dea035ae92 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1746 microversion: 2.20 time: 0.154904 Aug 30 02:12:07.372568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 521/1029] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:07 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:12:08.394941 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:08.395555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:08.402036 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:08.402516 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:08.402949 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:08.403714 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:08.404167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:08.404590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:08.408615 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:12:08.536990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:08.547458 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:08.549078 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:08.550325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-808e69c2-84b3-4709-9439-7a45a9c95163 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.159292 Aug 30 02:12:08.551205 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 509/1030] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:08 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:09.574368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:09.575072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:09.582538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:09.583040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:09.583480 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:09.584194 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:09.584652 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:09.585076 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:09.745557 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:09.754937 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:09.756660 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:09.757862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-355dc4fc-9be2-45f4-8a6f-ea0e72e475fa tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.187458 Aug 30 02:12:09.758417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 522/1031] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:09 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:09.895176 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-d3cd43b6-4a83-472d-890d-0142b43dfe0c req-a5916709-c0ed-4a6f-899e-52e7a6bf3963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "name": "network-vif-plugged", "status": "completed", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:12:09.906610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-d3cd43b6-4a83-472d-890d-0142b43dfe0c req-a5916709-c0ed-4a6f-899e-52e7a6bf3963 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:09.907091 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-d3cd43b6-4a83-472d-890d-0142b43dfe0c req-a5916709-c0ed-4a6f-899e-52e7a6bf3963 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:09.907538 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-d3cd43b6-4a83-472d-890d-0142b43dfe0c req-a5916709-c0ed-4a6f-899e-52e7a6bf3963 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:09.923007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-d3cd43b6-4a83-472d-890d-0142b43dfe0c req-a5916709-c0ed-4a6f-899e-52e7a6bf3963 service nova] Creating event network-vif-plugged:18104247-2f12-4918-9925-b466d738ce69 for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 on hv-cinder-81966 Aug 30 02:12:09.928788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-d3cd43b6-4a83-472d-890d-0142b43dfe0c req-a5916709-c0ed-4a6f-899e-52e7a6bf3963 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037099 Aug 30 02:12:09.929859 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 510/1032] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:12:10.781815 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:10.782432 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:10.789393 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:10.790187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:10.790846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:10.791787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:10.792462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:10.793120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:10.796235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=94 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:12:10.935675 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:10.944068 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:10.945582 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:10.946754 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-59bf9adf-ecad-4bcf-8971-21c900b5b8b2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.169492 Aug 30 02:12:10.958738 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 523/1033] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:10 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:11.970467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:11.971151 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:11.978136 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:11.978537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:11.979051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:11.979744 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:11.980195 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:11.980614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:12.123185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:12.131649 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:12.133853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:12.134487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ff2f75ac-12a6-451f-bbb4-85abe6de05ec tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.168936 Aug 30 02:12:12.135048 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 511/1034] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:11 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:13.159657 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:13.160385 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:13.167039 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:13.167520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:13.167952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:13.168708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:13.169944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:13.170375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:13.321982 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:13.331315 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:13.332780 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:13.334086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fc935bd6-aae8-42a7-9845-dfc32a01619e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.178792 Aug 30 02:12:13.335010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 524/1035] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:13 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:14.359767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:14.360407 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:14.367563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:14.368051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:14.368482 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:14.369219 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:14.369705 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:14.370130 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:14.510449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:14.526790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:14.528857 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:14.530558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7f602db0-b158-40bf-b82f-9095378c4fc2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.175095 Aug 30 02:12:14.534330 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 512/1036] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:14 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:15.553270 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:15.555783 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:15.562374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:15.562956 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:15.563492 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:15.564259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:15.564778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:15.565271 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:15.717804 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:15.729083 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:15.730605 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:15.733134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-439e7c59-fc5f-4cd2-8ea4-8d66f16bfa0c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.183587 Aug 30 02:12:15.746111 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 525/1037] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:15 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:16.757993 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:16.758614 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:16.765331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:16.765847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:16.766290 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:16.766996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:16.767452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:16.767880 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:16.920644 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:16.928771 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:16.930239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:16.931422 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b7163dd6-40ba-40e8-ad7a-4ca42343dfab tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.179075 Aug 30 02:12:16.933666 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 513/1038] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:16 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:17.955871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:17.956598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:17.964423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:17.964972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:17.965443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:17.966870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:17.967366 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:17.967793 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:18.097225 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:18.105790 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:18.107556 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:18.108706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-786818d3-c99d-44aa-ba36-fe037c281434 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.157465 Aug 30 02:12:18.109267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 526/1039] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:17 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:19.131670 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:19.135081 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:19.142788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:19.143499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:19.143935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:19.144782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:19.145237 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:19.145689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:19.354406 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:19.363291 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:19.364716 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:19.365912 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ba263b93-33d9-4b1c-84f3-528a2c9281e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1741 microversion: 2.20 time: 0.238275 Aug 30 02:12:19.366471 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 514/1040] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:19 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:20.388928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:20.389567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:20.395951 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:20.396434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:20.396868 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:20.397592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:20.398052 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:20.398478 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:20.530515 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:20.544632 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:20.546111 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:20.547280 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-49b335c6-ecf6-4407-bb39-315bb022b573 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1723 microversion: 2.20 time: 0.162423 Aug 30 02:12:20.547837 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 527/1041] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:20 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:12:21.570585 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:21.571169 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:21.573700 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=28 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:12:21.579007 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:21.579483 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:21.579913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:21.580599 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:21.581047 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:21.581481 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:21.709955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:21.718847 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:21.720278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:21.721449 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-cd1ea4db-9a6c-4ee7-adc7-f1651ab23589 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1723 microversion: 2.20 time: 0.154774 Aug 30 02:12:21.722099 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 515/1042] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:21 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:22.744193 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:22.744803 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:22.746731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=28 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:12:22.751643 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:22.753094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:22.753094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:22.753290 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:22.753706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:22.754132 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:22.887340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:22.896292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:22.897795 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:22.898953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0d8ad3af-73cb-469d-a420-a9a442d822de tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1726 microversion: 2.20 time: 0.158881 Aug 30 02:12:22.899520 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 528/1043] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:22 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:22.922962 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a0fd76a-a1be-4ba8-bac9-396ba0a515ae"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:12:22.925311 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:22.931921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:22.932399 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:22.932833 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:22.933550 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:22.934006 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:22.935160 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:23.875875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-eda8a390-4cf9-4e62-a314-d93630f3f42f tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.956881 Aug 30 02:12:23.876525 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 516/1044] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 30 02:12:22 2022] POST /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-volume_attachments => generated 188 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 02:12:23.886244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-baa39900-d2ab-47f8-9074-fa30b24c787f req-0cfc54e9-1b5d-4516-b4b6-5d58a09a7da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "name": "network-vif-unplugged", "status": "completed", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:12:23.898858 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-baa39900-d2ab-47f8-9074-fa30b24c787f req-0cfc54e9-1b5d-4516-b4b6-5d58a09a7da2 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:23.899274 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-baa39900-d2ab-47f8-9074-fa30b24c787f req-0cfc54e9-1b5d-4516-b4b6-5d58a09a7da2 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:23.899698 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-baa39900-d2ab-47f8-9074-fa30b24c787f req-0cfc54e9-1b5d-4516-b4b6-5d58a09a7da2 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:23.911242 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.compute.server_external_events [req-baa39900-d2ab-47f8-9074-fa30b24c787f req-0cfc54e9-1b5d-4516-b4b6-5d58a09a7da2 service nova] Unable to find a host for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448. Dropping event network-vif-unplugged {{(pid=121094) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 02:12:23.912118 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-baa39900-d2ab-47f8-9074-fa30b24c787f req-0cfc54e9-1b5d-4516-b4b6-5d58a09a7da2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030408 Aug 30 02:12:23.913477 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 529/1045] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 02:12:24.011961 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:24.012672 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:24.018850 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:24.019351 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:24.019775 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:24.020472 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:24.020920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:24.021336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:24.592984 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8d57328f-4c72-44ab-b979-0ed6f88e6d69 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-volume_attachments/5a0fd76a-a1be-4ba8-bac9-396ba0a515ae" status: 202 len: 0 microversion: 2.20 time: 0.584692 Aug 30 02:12:24.593627 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 517/1046] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 30 02:12:24 2022] DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-volume_attachments/5a0fd76a-a1be-4ba8-bac9-396ba0a515ae => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:12:24.659196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:12:24.659792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:24.665693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:24.666170 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:24.666602 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:24.667292 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:24.667745 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:24.668167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:24.697435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121094) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 02:12:24.995720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5a9921dd-1dd7-4bf0-bf65-8e60ec784a57 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "POST /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/action" status: 202 len: 0 microversion: 2.20 time: 0.340277 Aug 30 02:12:24.996367 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 530/1047] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 02:12:24 2022] POST /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:12:25.005600 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:25.006211 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:25.012031 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:25.012689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:25.013162 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:25.013924 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:25.014369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:25.014788 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:25.144522 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:25.153307 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:25.155002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:25.157089 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-dda9306d-542e-49b6-8915-0a5a75c647e3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1674 microversion: 2.20 time: 0.155392 Aug 30 02:12:25.158071 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 518/1048] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:25 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:26.181207 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:26.181787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:26.188289 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:26.188771 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:26.189236 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:26.189939 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:26.190459 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:26.190883 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:26.330526 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:26.339140 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:26.342415 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:26.342415 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-93e5398a-3b17-4ac4-a573-4fddc08ae1d4 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1674 microversion: 2.20 time: 0.165753 Aug 30 02:12:26.343241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 531/1049] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:26 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:27.364735 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:27.365470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:27.372370 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:27.372851 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:27.373279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:27.374001 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:27.374448 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:27.374866 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:27.584778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:27.593239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:27.594795 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:27.595965 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d3a7b466-0299-485e-8c12-4f9c6fdb4443 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.235251 Aug 30 02:12:27.596523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 519/1050] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:27 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:28.627343 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:28.628747 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:28.638122 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:28.639138 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:28.639874 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:28.640945 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:28.641761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:28.642583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:29.047043 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:29.056482 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:29.058299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:29.059588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5e31fe18-8076-420b-83b6-ba8cec02b228 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.443765 Aug 30 02:12:29.060235 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 532/1051] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:28 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:30.084438 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:30.085096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:30.092955 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:30.093567 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:30.094112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:30.094921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:30.095550 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:30.095971 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:30.247524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:30.258738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:30.260923 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:30.263830 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7d35b46b-2826-4519-976a-20c8a97ccad3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.183459 Aug 30 02:12:30.267538 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 520/1052] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:30 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:31.289497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:31.289497 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:31.297953 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:31.298827 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:31.299488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:31.300438 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:31.301105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:31.301768 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:31.439964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:31.452009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:31.454461 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:31.456196 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d52d100a-315d-439c-b9c4-a87c8b6fc1e9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.173334 Aug 30 02:12:31.457067 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 533/1053] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:31 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:32.482561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:32.483475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:32.490786 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:32.491276 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:32.491711 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:32.492418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:32.492874 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:32.493299 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:32.499386 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:12:32.651490 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:32.661335 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:32.662801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:32.663968 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0e8bd289-9768-4be9-8622-1c2b57d6cfc3 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.186505 Aug 30 02:12:32.665876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 521/1054] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:32 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:33.689954 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:33.691615 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:33.701251 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:33.702616 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:33.703375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:33.704806 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:33.705735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:33.706578 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:33.856831 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:33.866588 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:33.868182 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:33.869549 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2a2d9eb6-6c61-4732-a0d1-8bfb296fa324 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.183876 Aug 30 02:12:33.870460 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 534/1055] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:33 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:34.893122 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:34.893783 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:34.900418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:34.900905 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:34.901337 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:34.902067 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:34.903068 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:34.903708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:35.042451 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:35.051475 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:35.053054 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:35.054285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-fcf124d5-d8bc-4c9f-9784-6f6c1d291987 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.165130 Aug 30 02:12:35.069869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 522/1056] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:34 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:36.079086 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:36.079763 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:36.086785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:36.087291 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:36.087724 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:36.088522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:36.089012 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:36.089598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:36.222634 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:36.230304 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:36.232797 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:36.234120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-571b9202-8ffd-4d96-a91d-1f174b49bf93 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.158977 Aug 30 02:12:36.234680 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 535/1057] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:36 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:37.257813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:37.258518 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:37.265212 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:37.267964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:37.267964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:37.267964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:37.267964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:37.268409 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:37.400952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:37.409910 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:37.411413 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:37.412558 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-00d2a276-23f6-427b-8be2-18c15df007b9 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.158869 Aug 30 02:12:37.413112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 523/1058] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:37 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:38.436358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:38.436968 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:38.443420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:38.443897 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:38.444328 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:38.445025 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:38.445920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:38.445920 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:38.573184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:38.581215 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:38.582705 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:38.583848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-63463cc1-720d-49bc-a825-703966161e33 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.152177 Aug 30 02:12:38.584400 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 536/1059] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:38 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:39.608089 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:39.608698 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:39.615294 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:39.615777 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:39.616214 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:39.616936 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:39.617395 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:39.617850 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:39.749065 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:39.757171 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:39.758636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:39.759782 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b8043e15-e653-4028-8656-45f1552528d2 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.156583 Aug 30 02:12:39.760334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 524/1060] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:39 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:40.783981 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:40.784628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:40.791234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:40.791711 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:40.792146 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:40.792841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:40.793305 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:40.793827 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:40.924299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:40.926568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:12:40.933026 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:40.935049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:40.936200 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-50a9a690-47b0-4bcc-917d-cb3daa065d97 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.156163 Aug 30 02:12:40.936761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 537/1061] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:40 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:41.959828 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:41.960433 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:41.967009 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:41.967491 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:41.967920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:41.968620 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:41.969074 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:41.969524 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:42.028278 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-a2c99714-c617-4888-b41b-76e394ef36d8 req-1c8ee443-2d0c-48c9-9dbc-0755f38eec2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "name": "network-vif-plugged", "status": "completed", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:12:42.039990 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a2c99714-c617-4888-b41b-76e394ef36d8 req-1c8ee443-2d0c-48c9-9dbc-0755f38eec2c service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:42.040583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a2c99714-c617-4888-b41b-76e394ef36d8 req-1c8ee443-2d0c-48c9-9dbc-0755f38eec2c service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:42.041009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a2c99714-c617-4888-b41b-76e394ef36d8 req-1c8ee443-2d0c-48c9-9dbc-0755f38eec2c service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:42.053143 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-a2c99714-c617-4888-b41b-76e394ef36d8 req-1c8ee443-2d0c-48c9-9dbc-0755f38eec2c service nova] Creating event network-vif-plugged:18104247-2f12-4918-9925-b466d738ce69 for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 on hv-cinder-81966 Aug 30 02:12:42.058443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-a2c99714-c617-4888-b41b-76e394ef36d8 req-1c8ee443-2d0c-48c9-9dbc-0755f38eec2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Aug 30 02:12:42.059884 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 538/1062] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:12:42.109602 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:42.114499 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:42.115921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:42.117150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ee8584b8-e136-4397-bfb6-10edfe26a31c tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.161266 Aug 30 02:12:42.117731 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 525/1063] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:41 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:43.142024 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:43.142696 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:43.149713 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:43.152865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:43.152865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:43.152865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:43.152865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:43.153417 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:43.281365 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:43.289427 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:43.290903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:43.292061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-27141ea4-68ed-4e5f-a23b-3797be440737 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.154896 Aug 30 02:12:43.292620 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 539/1064] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:43 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:44.315172 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:44.315812 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:44.322863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:44.323353 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:44.323793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:44.325255 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:44.325871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:44.326307 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:44.460796 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:44.469677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:44.471127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:44.472393 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-03167872-37b7-47ea-9953-101411d45757 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1732 microversion: 2.20 time: 0.161241 Aug 30 02:12:44.472940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 526/1065] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:44 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:12:45.496749 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:12:45.497691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:12:45.504129 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:45.504611 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:45.505047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:45.505762 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:12:45.506220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:12:45.506646 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:12:45.635977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:45.644661 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:45.646135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:12:45.647289 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-606e6308-aec0-4c50-a3c4-87b220f06381 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1719 microversion: 2.20 time: 0.154954 Aug 30 02:12:45.647849 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 540/1066] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:12:45 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:13:04.054095 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:04.060069 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:04.061778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:04.062654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=15 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:04.067008 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=23 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:04.067667 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=34 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:04.069967 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:04.071300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:04.071300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:04.071803 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:04.072259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:04.072778 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:04.102397 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Going to try to terminate instance {{(pid=121093) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:13:04.123434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-442f077a-6f6c-4a2a-81b2-afa2dbf20722 req-ee0a327b-8d4c-482e-a014-1f6757135659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:13:04.134581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-442f077a-6f6c-4a2a-81b2-afa2dbf20722 req-ee0a327b-8d4c-482e-a014-1f6757135659 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:04.135145 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-442f077a-6f6c-4a2a-81b2-afa2dbf20722 req-ee0a327b-8d4c-482e-a014-1f6757135659 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:04.135886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-442f077a-6f6c-4a2a-81b2-afa2dbf20722 req-ee0a327b-8d4c-482e-a014-1f6757135659 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:04.151248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-442f077a-6f6c-4a2a-81b2-afa2dbf20722 req-ee0a327b-8d4c-482e-a014-1f6757135659 service nova] Creating event network-changed:ad71926d-6c2f-4698-a7f2-9471cb54c167 for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 on hv-cinder-81966 Aug 30 02:13:04.156726 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-442f077a-6f6c-4a2a-81b2-afa2dbf20722 req-ee0a327b-8d4c-482e-a014-1f6757135659 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100755 Aug 30 02:13:04.157342 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 541/1067] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:13:04.379806 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5245285f-30c0-4673-a0de-0f90b728c254 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 204 len: 0 microversion: 2.1 time: 0.329255 Aug 30 02:13:04.380323 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 527/1068] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:13:04 2022] DELETE /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:13:04.391564 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:04.395834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:04.400742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:04.401053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:04.402068 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:04.402964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:04.403597 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:04.404173 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:04.553047 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:04.563693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1a3d85b1-3805-45c9-82ff-cbbed49e0ed0 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.178644 Aug 30 02:13:04.564279 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 542/1069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:04 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:05.588814 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:05.590239 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:05.597402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:05.597940 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:05.598356 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:05.599057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:05.599603 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:05.600033 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:05.791133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:05.799295 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-1de803dd-ae33-4ba3-b4ef-65da218c7793 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1569 microversion: 2.1 time: 0.214705 Aug 30 02:13:05.799868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 528/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:05 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:13:06.629646 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-3bb1321b-9d51-45f3-857d-5a8ac517c22d req-9689967f-9b36-4d54-9331-51338fcea6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf95bad-7b69-4e0b-af1e-53e1370e21b8", "name": "network-vif-deleted", "tag": "ad71926d-6c2f-4698-a7f2-9471cb54c167"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:13:06.639064 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-3bb1321b-9d51-45f3-857d-5a8ac517c22d req-9689967f-9b36-4d54-9331-51338fcea6d1 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:06.639543 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-3bb1321b-9d51-45f3-857d-5a8ac517c22d req-9689967f-9b36-4d54-9331-51338fcea6d1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:06.639968 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-3bb1321b-9d51-45f3-857d-5a8ac517c22d req-9689967f-9b36-4d54-9331-51338fcea6d1 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:06.651116 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-3bb1321b-9d51-45f3-857d-5a8ac517c22d req-9689967f-9b36-4d54-9331-51338fcea6d1 service nova] Creating event network-vif-deleted:ad71926d-6c2f-4698-a7f2-9471cb54c167 for instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 on hv-cinder-81966 Aug 30 02:13:06.656483 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-3bb1321b-9d51-45f3-857d-5a8ac517c22d req-9689967f-9b36-4d54-9331-51338fcea6d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085335 Aug 30 02:13:06.657065 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 543/1071] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:13:06.824606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:06.825417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:06.832750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:06.833652 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:06.834124 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:06.834831 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:06.835285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:06.835768 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:06.904529 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:06.912489 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e87bea8c-2551-4792-95f1-5c09ef6cbe47 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1220 microversion: 2.1 time: 0.095623 Aug 30 02:13:06.913056 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 529/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:06 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:07.934076 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:07.935283 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:07.941698 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:07.942181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:07.942615 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:07.943351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:07.943801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:07.944221 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:07.975480 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:07.975959 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:07.976389 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:07.976827 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lazy-loading 'fault' on Instance uuid 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:13:08.018926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04f1ec1a3d964e34838b14f636cdf13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e5b69be3a9b4ec0b5038f51a918bf27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:08.026785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1e6e1871-1ba5-45e3-ad7c-a544422cf3c8 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 200 len: 1225 microversion: 2.1 time: 0.097522 Aug 30 02:13:08.027347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 544/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:07 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:09.054297 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:09.054931 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] [instance: 9bf95bad-7b69-4e0b-af1e-53e1370e21b8] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:09.061918 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:09.062393 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:09.062823 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:09.063504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:09.063950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:09.064369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:09.078191 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] HTTP exception thrown: Instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 could not be found. Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Request method failure captured: Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 HTTP/1.1 Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXEWTJrlj-VNIGQw2nDQBiE-2ye6-4-Ev3MAYCS_FA_m8viHNLrIQvl61ygaZlXipcktNQFpYsY5yX7dXN4bx4-UTDPTOskFuvQ-FZ2AkXEVr98LOQw72xtdegTsdeJGNfkYZGpeSnCIoJIPvwjW3y3JAFpT9nc0c1FAzZXT8346f9Q Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: 7e5b69be3a9b4ec0b5038f51a918bf27 Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-TestShelveInstance-1554592241 Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:13:09.079849 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e5b69be3a9b4ec0b5038f51a918bf27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e5b69be3a9b4ec0b5038f51a918bf27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e5b69be3a9b4ec0b5038f51a918bf27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e5b69be3a9b4ec0b5038f51a918bf27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-TestShelveInstance-1554592241 Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: 7e5b69be3a9b4ec0b5038f51a918bf27 Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-TestShelveInstance-1554592241 Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-TestShelveInstance-1554592241-project Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 04f1ec1a3d964e34838b14f636cdf13d Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-TestShelveInstance-1554592241-project Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 could not be found. Aug 30 02:13:09.081636 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '9bf95bad-7b69-4e0b-af1e-53e1370e21b8'} Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 could not be found. Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:09.082738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 could not be found. Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 could not be found. Aug 30 02:13:09.084374 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:09.086102 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Returning 404 to user: Instance 9bf95bad-7b69-4e0b-af1e-53e1370e21b8 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:09.086102 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-3f8f79e2-91b3-4868-b855-75047b8c853d tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8" status: 404 len: 111 microversion: 2.1 time: 0.030742 Aug 30 02:13:09.086102 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 530/1074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:09 2022] GET /compute/v2.1/servers/9bf95bad-7b69-4e0b-af1e-53e1370e21b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:13:09.312341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-cb0b70d9-9f35-45bf-aa8d-b43183af17c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] Calling method '.version_select at 0x7f47367b4280>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:09.380409 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-cb0b70d9-9f35-45bf-aa8d-b43183af17c9 tempest-TestShelveInstance-1554592241 tempest-TestShelveInstance-1554592241-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1690764204" status: 202 len: 0 microversion: 2.1 time: 0.072225 Aug 30 02:13:09.380999 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 545/1075] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 02:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1690764204 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 02:13:16.313308 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:16.317582 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:16.322251 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:16.322729 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:16.323159 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:16.323853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:16.324304 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:16.324721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:16.358759 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-51b11a59-41ac-49df-a840-acbfd5b8befc tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049533 Aug 30 02:13:16.359221 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 531/1076] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 02:13:16 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:13:16.436787 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:16.437313 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:16.448108 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:16.448590 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:16.449022 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:16.449810 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:16.450871 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:16.451394 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:16.477696 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:13:16.810788 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6b992562-2069-4f34-ad18-ae0bee9a1868 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 204 len: 0 microversion: 2.20 time: 0.379137 Aug 30 02:13:16.811374 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 546/1077] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 02:13:16 2022] DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 02:13:16.819640 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:16.820253 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:16.827056 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:16.827526 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:16.827962 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:16.828657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:16.829112 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:16.829562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:16.957801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:16.966075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:16.967523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:16.968681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-59eea0e9-e6a9-4fe1-be3b-548584287d74 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.152920 Aug 30 02:13:16.969236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 532/1078] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:13:16 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 02:13:17.992685 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:17.996337 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:18.000640 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:18.001133 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:18.001601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:18.002435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:18.002905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:18.003340 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:18.141647 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:18.150174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:18.151794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:18.152949 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7b2da423-ee7c-4d57-8d1c-ffa1bb74ad20 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1725 microversion: 2.20 time: 0.165355 Aug 30 02:13:18.161635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 547/1079] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:13:17 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:13:19.176205 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:19.176810 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:19.184103 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:19.185473 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:19.186096 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:19.186855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:19.187316 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:19.187797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:19.202735 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-a1448be7-f567-4d25-b298-bd2de3cc28ae req-de365a6e-670e-4214-834a-b7a3a3a4fc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e1ee8-ce44-49a5-b490-ab729c82e448", "name": "network-vif-deleted", "tag": "18104247-2f12-4918-9925-b466d738ce69"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:13:19.212637 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a1448be7-f567-4d25-b298-bd2de3cc28ae req-de365a6e-670e-4214-834a-b7a3a3a4fc35 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:19.213111 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a1448be7-f567-4d25-b298-bd2de3cc28ae req-de365a6e-670e-4214-834a-b7a3a3a4fc35 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:19.213773 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-a1448be7-f567-4d25-b298-bd2de3cc28ae req-de365a6e-670e-4214-834a-b7a3a3a4fc35 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:19.228234 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-a1448be7-f567-4d25-b298-bd2de3cc28ae req-de365a6e-670e-4214-834a-b7a3a3a4fc35 service nova] Creating event network-vif-deleted:18104247-2f12-4918-9925-b466d738ce69 for instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 on hv-cinder-81966 Aug 30 02:13:19.234592 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-a1448be7-f567-4d25-b298-bd2de3cc28ae req-de365a6e-670e-4214-834a-b7a3a3a4fc35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 Aug 30 02:13:19.235583 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 548/1080] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:13:19.262278 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:19.271560 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:19.273002 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3eb33b1b787447daa68b651f9686574a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abe39137b275484ea6dafbed8d826eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:19.274244 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-0d0f1945-2f1d-452e-821e-259c51b89578 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 200 len: 1657 microversion: 2.20 time: 0.101949 Aug 30 02:13:19.286596 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 533/1081] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:13:19 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 1657 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 02:13:20.300204 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:20.300923 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:20.307601 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:20.308118 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:20.308555 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:20.309839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:20.310336 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:20.310737 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:20.324073 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] HTTP exception thrown: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Request method failure captured: Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 HTTP/1.1 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXD68XbvyE8BS81tJh_FVxtPetfI7dE3liduTJdmoseg4QixaAu-tYzR6r3ZW-Lk1tnimrv_zLQJ1k2pIXY7NJA4whnNavAaU9w6AOktvFGV3HF-jBbWTMCcC5n9Iqi1gn2Vwligr7oRL6idLnnYDT5QNGh-We7JefmXU-fXc2tD-Wc Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:13:20.325781 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 3eb33b1b787447daa68b651f9686574a Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:20.327507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '1a0e1ee8-ce44-49a5-b490-ab729c82e448'} Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:20.331630 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:20.333082 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:20.334536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Returning 404 to user: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:20.334536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-becea578-b281-4407-8c76-a9d0db6ed2a7 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 404 len: 111 microversion: 2.20 time: 0.031717 Aug 30 02:13:20.334536 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 549/1082] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:13:20 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:13:20.336183 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-305299c3-43c2-4f8c-9971-6fbe00531606 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '.version_select at 0x7f47364fb0d0>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:20.340750 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR oslo.messaging._drivers.impl_rabbit [None req-305299c3-43c2-4f8c-9971-6fbe00531606 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [ee1f91d7-332f-4899-b8dc-f92ab154d540] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 02:13:21.347874 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO oslo.messaging._drivers.impl_rabbit [None req-305299c3-43c2-4f8c-9971-6fbe00531606 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [ee1f91d7-332f-4899-b8dc-f92ab154d540] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56464. Aug 30 02:13:21.420864 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-305299c3-43c2-4f8c-9971-6fbe00531606 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721879125" status: 204 len: 0 microversion: 2.20 time: 1.088385 Aug 30 02:13:21.421434 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 534/1083] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 02:13:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721879125 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 02:13:23.448100 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:23.448619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:23.454666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:23.455146 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:23.455574 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:23.456259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:23.456706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:23.457123 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:23.472368 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] HTTP exception thrown: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Request method failure captured: Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 HTTP/1.1 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXD68XbvyE8BS81tJh_FVxtPetfI7dE3liduTJdmoseg4QixaAu-tYzR6r3ZW-Lk1tnimrv_zLQJ1k2pIXY7NJA4whnNavAaU9w6AOktvFGV3HF-jBbWTMCcC5n9Iqi1gn2Vwligr7oRL6idLnnYDT5QNGh-We7JefmXU-fXc2tD-Wc Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:13:23.473946 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 3eb33b1b787447daa68b651f9686574a Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.475567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '1a0e1ee8-ce44-49a5-b490-ab729c82e448'} Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:23.477106 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.478584 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.480205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Returning 404 to user: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:23.480205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2930e656-4ee9-4ff1-92d8-d544b20faee5 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 404 len: 111 microversion: 2.20 time: 0.031091 Aug 30 02:13:23.480205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 550/1084] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 02:13:23 2022] DELETE /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:13:23.484985 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:23.485626 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 1a0e1ee8-ce44-49a5-b490-ab729c82e448] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:23.491510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:23.491990 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:23.492421 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:23.493109 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:23.493602 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:23.494029 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:23.507571 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] HTTP exception thrown: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Request method failure captured: Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 HTTP/1.1 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXD68XbvyE8BS81tJh_FVxtPetfI7dE3liduTJdmoseg4QixaAu-tYzR6r3ZW-Lk1tnimrv_zLQJ1k2pIXY7NJA4whnNavAaU9w6AOktvFGV3HF-jBbWTMCcC5n9Iqi1gn2Vwligr7oRL6idLnnYDT5QNGh-We7JefmXU-fXc2tD-Wc Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:13:23.509087 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 3eb33b1b787447daa68b651f9686574a Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.510794 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '1a0e1ee8-ce44-49a5-b490-ab729c82e448'} Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:23.511712 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. Aug 30 02:13:23.513238 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:23.514634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Returning 404 to user: Instance 1a0e1ee8-ce44-49a5-b490-ab729c82e448 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:23.514634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-55ac0584-914c-4e7c-9613-df2812d78bef tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448" status: 404 len: 111 microversion: 2.20 time: 0.030742 Aug 30 02:13:23.514634 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 535/1085] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:13:23 2022] GET /compute/v2.1/servers/1a0e1ee8-ce44-49a5-b490-ab729c82e448 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:13:24.784231 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:24.784733 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:24.791317 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:24.791792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:24.792220 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:24.792900 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:24.793347 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:24.794363 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:24.807430 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] HTTP exception thrown: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Request method failure captured: Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 HTTP/1.1 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXD68XbvyE8BS81tJh_FVxtPetfI7dE3liduTJdmoseg4QixaAu-tYzR6r3ZW-Lk1tnimrv_zLQJ1k2pIXY7NJA4whnNavAaU9w6AOktvFGV3HF-jBbWTMCcC5n9Iqi1gn2Vwligr7oRL6idLnnYDT5QNGh-We7JefmXU-fXc2tD-Wc Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:13:24.808983 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 3eb33b1b787447daa68b651f9686574a Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.811373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': '8ba259a7-78bc-4133-88dc-6c4724cc3ec9'} Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:24.812452 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.813960 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.815654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Returning 404 to user: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:24.815654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bf2d2bb2-6ab3-4ed8-b67e-39d4ff3b075e tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 404 len: 111 microversion: 2.20 time: 0.030672 Aug 30 02:13:24.815654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 551/1086] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 02:13:24 2022] DELETE /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:13:24.819556 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:24.820170 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] [instance: 8ba259a7-78bc-4133-88dc-6c4724cc3ec9] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:24.827305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:24.827799 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:24.828232 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:24.828935 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:24.829378 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:24.829824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:24.843681 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] HTTP exception thrown: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Request method failure captured: Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 HTTP/1.1 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXD68XbvyE8BS81tJh_FVxtPetfI7dE3liduTJdmoseg4QixaAu-tYzR6r3ZW-Lk1tnimrv_zLQJ1k2pIXY7NJA4whnNavAaU9w6AOktvFGV3HF-jBbWTMCcC5n9Iqi1gn2Vwligr7oRL6idLnnYDT5QNGh-We7JefmXU-fXc2tD-Wc Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:13:24.845123 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abe39137b275484ea6dafbed8d826eb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: abe39137b275484ea6dafbed8d826eb3 Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2064675618 Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 3eb33b1b787447daa68b651f9686574a Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2064675618-project Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.846945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '8ba259a7-78bc-4133-88dc-6c4724cc3ec9'} Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:24.848062 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. Aug 30 02:13:24.849535 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:13:24.850934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] Returning 404 to user: Instance 8ba259a7-78bc-4133-88dc-6c4724cc3ec9 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:24.850934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-efd2dcbf-be42-4c5e-a2ff-5e6b70160c99 tempest-AttachVolumeShelveTestJSON-2064675618 tempest-AttachVolumeShelveTestJSON-2064675618-project] 10.222.0.27 "GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9" status: 404 len: 111 microversion: 2.20 time: 0.030985 Aug 30 02:13:24.850934 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 536/1087] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 02:13:24 2022] GET /compute/v2.1/servers/8ba259a7-78bc-4133-88dc-6c4724cc3ec9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 02:13:45.406163 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:45.406750 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:45.409205 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:45.409888 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:45.414451 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:45.414927 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:45.415358 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:45.416038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:45.416484 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:45.416898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:45.442211 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:13:45.730013 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e19993fb-f030-4bd5-834d-45b99827e721 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 204 len: 0 microversion: 2.1 time: 0.328362 Aug 30 02:13:45.733226 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 552/1088] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:13:45 2022] DELETE /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:13:45.738964 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:45.739564 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:45.741871 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:45.742511 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:13:45.747541 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:45.748027 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:45.748459 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:45.749150 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:45.749637 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:45.750057 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:45.885259 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:45.893777 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-883ae850-2c0e-4142-b0d3-040d6dc25f55 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1578 microversion: 2.1 time: 0.158527 Aug 30 02:13:45.894338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 537/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:45 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:46.920236 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:46.920932 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:46.927814 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:46.928299 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:46.928727 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:46.929421 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:46.929893 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:46.930312 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:47.068743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:47.077040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-875c73e4-2075-48d5-804f-3eecea23ee8e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1578 microversion: 2.1 time: 0.161574 Aug 30 02:13:47.077722 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 553/1090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:46 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:48.099537 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:48.100155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:48.108506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:48.109182 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:48.109646 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:48.110358 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:48.110813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:48.111236 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:48.221361 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:48.229881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-165b9f97-9660-4e8d-90a3-c1367b6ab4ac tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1510 microversion: 2.1 time: 0.134561 Aug 30 02:13:48.242375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 538/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:48 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:48.429538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-dfda728e-4ccf-41ff-9125-1c939c684dd9 req-99ee7e6b-3c7b-484c-9ace-e41ea450187a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1130974-c6cb-4808-9dce-76f961f71ac6", "name": "network-vif-deleted", "tag": "794625df-3536-4bb3-a640-e90e2e2cd74e"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:13:48.440413 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-dfda728e-4ccf-41ff-9125-1c939c684dd9 req-99ee7e6b-3c7b-484c-9ace-e41ea450187a service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:48.441210 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-dfda728e-4ccf-41ff-9125-1c939c684dd9 req-99ee7e6b-3c7b-484c-9ace-e41ea450187a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:48.441692 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-dfda728e-4ccf-41ff-9125-1c939c684dd9 req-99ee7e6b-3c7b-484c-9ace-e41ea450187a service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:48.453314 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-dfda728e-4ccf-41ff-9125-1c939c684dd9 req-99ee7e6b-3c7b-484c-9ace-e41ea450187a service nova] Creating event network-vif-deleted:794625df-3536-4bb3-a640-e90e2e2cd74e for instance a1130974-c6cb-4808-9dce-76f961f71ac6 on hv-cinder-81966 Aug 30 02:13:48.458256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-dfda728e-4ccf-41ff-9125-1c939c684dd9 req-99ee7e6b-3c7b-484c-9ace-e41ea450187a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033188 Aug 30 02:13:48.458848 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 554/1092] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:13:49.252279 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:49.253281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:49.260495 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:49.260989 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:49.261424 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:49.262840 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:49.263384 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:49.263755 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:49.295733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:49.296217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:49.296651 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:49.297094 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lazy-loading 'fault' on Instance uuid a1130974-c6cb-4808-9dce-76f961f71ac6 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:13:49.341950 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:49.349684 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c1285edd-6910-4f64-b6a1-9f1c9a681975 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1231 microversion: 2.1 time: 0.101193 Aug 30 02:13:49.350381 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 539/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:49 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:50.375029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:50.375669 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:50.382105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:50.382628 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:50.383049 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:50.383746 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:50.384202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:50.384624 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:50.414807 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:50.415282 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:50.415715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:50.416156 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.objects.instance [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lazy-loading 'fault' on Instance uuid a1130974-c6cb-4808-9dce-76f961f71ac6 {{(pid=121094) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:13:50.456938 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:50.464517 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7fe281e3-06bf-4b5f-ba50-48358c8316e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1231 microversion: 2.1 time: 0.094874 Aug 30 02:13:50.465416 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 555/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:50 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:51.485405 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:51.486043 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:51.492447 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:51.492930 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:51.493365 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:51.494079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:51.494531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:51.494954 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:51.525392 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:51.525897 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:51.526331 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:51.526772 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.objects.instance [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lazy-loading 'fault' on Instance uuid a1130974-c6cb-4808-9dce-76f961f71ac6 {{(pid=121093) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 02:13:51.566722 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:51.574770 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1e399bd-2d66-4e8e-bb12-3c52dce3a847 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 200 len: 1231 microversion: 2.1 time: 0.093442 Aug 30 02:13:51.575287 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 540/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:51 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:52.595834 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:52.596445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:52.602379 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:52.602855 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:52.603286 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:52.603972 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:52.604420 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:52.604838 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:52.618134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] HTTP exception thrown: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Request method failure captured: Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 HTTP/1.1 Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXGyZZKgcA_fo0az3AGk2kAL-TGoHlkrFPmmtxn_yZdB4zdVyGRXq7xxte61x8q5DzUuWdzP6OzDnx53jcHai8Ip4VTt7VylyT1o7LJB27_09Fcm0EjjNlXE0h3RVAvMVtebJfKNtAG0z0ctocJ34IB5Va2PfgftAez2eyXNtR00NBs Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:13:52.619794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 40e0086c1b924e7f86bd814bb45be3d9 Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:13:52.621870 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'a1130974-c6cb-4808-9dce-76f961f71ac6'} Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:13:52.623054 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:13:52.624659 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:13:52.626109 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Returning 404 to user: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:13:52.626109 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f152fd27-4a52-4409-ba61-c204d5adbea9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 404 len: 111 microversion: 2.1 time: 0.029365 Aug 30 02:13:52.626109 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 556/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:52 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:13:52.715889 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-641003693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1822245242", "security_groups": [{"name": "tempest-secgroup-smoke-1411314915"}], "block_device_mapping_v2": [{"uuid": "beba143a-106e-4647-926e-6974cb8b6a55", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b43df500-c05c-42ca-b288-93458deb45ab"}]}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:13:52.830298 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.network.neutron [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] validate_networks() for [('b43df500-c05c-42ca-b288-93458deb45ab', None, None, None, None, None)] {{(pid=121093) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:13:53.313988 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Flavor limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:13:53.314539 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Image limits 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:13:53.315017 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Flavor pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:13:53.315430 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Image pref 0:0:0 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:13:53.315843 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.virt.hardware [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121093) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:13:53.324865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:53.325784 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:53.326553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:53.327913 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:53.328781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:53.329627 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:53.349791 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for project fa2e7ced1148461faedcd0e1856bae95. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:13:53.353781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.quota [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for user 40e0086c1b924e7f86bd814bb45be3d9 and project fa2e7ced1148461faedcd0e1856bae95. Resources: {'ram', 'instances', 'cores'} {{(pid=121093) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:13:53.417181 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Going to run 1 instances... {{(pid=121093) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:13:53.420131 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='beba143a-106e-4647-926e-6974cb8b6a55',volume_size=None,volume_type=None)] {{(pid=121093) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:13:53.838418 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [165e879e-c833-4b0b-ba39-b2044404b7a7] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 02:13:54.853555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [165e879e-c833-4b0b-ba39-b2044404b7a7] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 56748. Aug 30 02:13:54.858945 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-9f1d45a8-37e3-434a-9a08-c91c2bf73996 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.147290 Aug 30 02:13:54.859606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 541/1097] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:13:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:13:54.870203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-e0c3649a-f0e5-4220-8e79-fd06850cbef4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:54.871529 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-e0c3649a-f0e5-4220-8e79-fd06850cbef4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:54.924981 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-e0c3649a-f0e5-4220-8e79-fd06850cbef4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:54.931853 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-e0c3649a-f0e5-4220-8e79-fd06850cbef4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1094 microversion: 2.1 time: 0.065420 Aug 30 02:13:54.932423 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 557/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:54 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:55.953366 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:55.954012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:55.960224 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:55.960702 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:55.961137 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:55.961860 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:55.962314 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:55.962737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:56.022404 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:56.030481 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ed13446f-4376-4073-bbae-b17643424ae2 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1144 microversion: 2.1 time: 0.081561 Aug 30 02:13:56.031038 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 542/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:55 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:57.051410 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:57.052025 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:57.059697 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:57.062792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:57.062792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:57.062792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:57.062792 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:57.063229 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:57.124285 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:57.132010 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-cc2895c2-0b51-4c1a-98bf-4ba56e8da3d5 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1144 microversion: 2.1 time: 0.084616 Aug 30 02:13:57.132576 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 558/1100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:57 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:58.153751 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:58.154360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:58.160658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:58.161138 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:58.161590 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:58.162275 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:58.162723 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:58.163141 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:58.228139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:58.236880 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-35046d2f-27e0-4662-85ea-3fb58106704b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1192 microversion: 2.1 time: 0.087933 Aug 30 02:13:58.237506 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 543/1101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:58 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:13:59.260490 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:13:59.261209 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:13:59.269145 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:59.269436 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:59.269956 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:59.270654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:13:59.271142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:13:59.271567 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:13:59.423731 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:13:59.432140 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8d805a1c-e5df-4a23-8c1d-b00ce9eba4be tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1278 microversion: 2.1 time: 0.177462 Aug 30 02:13:59.432743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 559/1102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:13:59 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:00.204412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-b9086f5a-e501-464e-a6f5-a4d07017e81c req-01e930b7-967d-4f11-bc51-212b6a819349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a9a828-0b3a-42a1-b60b-a69e4deba7ae", "tag": "f424f2ec-8140-4609-be8e-5ad9935b214e"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:14:00.215619 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-b9086f5a-e501-464e-a6f5-a4d07017e81c req-01e930b7-967d-4f11-bc51-212b6a819349 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:00.216106 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-b9086f5a-e501-464e-a6f5-a4d07017e81c req-01e930b7-967d-4f11-bc51-212b6a819349 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:00.216540 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-b9086f5a-e501-464e-a6f5-a4d07017e81c req-01e930b7-967d-4f11-bc51-212b6a819349 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:00.227676 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-b9086f5a-e501-464e-a6f5-a4d07017e81c req-01e930b7-967d-4f11-bc51-212b6a819349 service nova] Creating event network-changed:f424f2ec-8140-4609-be8e-5ad9935b214e for instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae on hv-cinder-81966 Aug 30 02:14:00.233293 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-b9086f5a-e501-464e-a6f5-a4d07017e81c req-01e930b7-967d-4f11-bc51-212b6a819349 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033410 Aug 30 02:14:00.234451 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 544/1103] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:14:00.453859 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:00.454443 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:00.460723 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:00.461202 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:00.461688 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:00.462390 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:00.462844 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:00.463265 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:00.600139 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:00.608654 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7f43ff9a-7869-46a0-b00d-2a2016d333d9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.158783 Aug 30 02:14:00.609507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 560/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:00 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:14:01.631155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:01.631855 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:01.638751 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:01.639227 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:01.639656 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:01.640339 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:01.640801 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:01.641217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:01.776570 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:01.784815 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ae3db464-b5ff-4442-9455-c337a8d80594 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.157869 Aug 30 02:14:01.785373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 545/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:01 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:02.805928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:02.806532 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:02.812977 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:02.813478 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:02.813913 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:02.814595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:02.815045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:02.815464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:02.955896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:02.963561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4538d647-ef6b-405f-a56c-8c80dc65df05 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.161469 Aug 30 02:14:02.964128 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 561/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:02 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:03.985182 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:03.985753 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:03.988167 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:14:03.988875 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=6 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:14:03.993574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:03.995888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:03.995888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:03.995888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:03.995888 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:03.996472 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:04.130363 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:04.138920 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4f64df5a-3a2d-47dd-854a-b4b528d9d936 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.158344 Aug 30 02:14:04.139531 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 546/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:03 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:05.160077 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:05.160686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:05.164150 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:14:05.171827 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:05.175903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:05.175903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:05.175903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:05.175903 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:05.176275 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:05.305742 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:05.314381 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a6c51c1f-f296-417b-ac97-fe81e31d0022 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.158132 Aug 30 02:14:05.314952 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 562/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:05 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:06.335012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:06.335648 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:06.342624 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:06.343118 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:06.343547 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:06.344346 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:06.344974 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:06.345402 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:06.490272 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:06.499285 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a3e74e3b-71d5-401f-b7bb-ca6405708854 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.168387 Aug 30 02:14:06.499858 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 547/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:06 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:07.526003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:07.527261 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:07.534466 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:07.534950 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:07.535386 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:07.536080 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:07.536537 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:07.536961 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:07.675061 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:07.682892 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-2bf2cb4a-594c-4211-983b-ebe90f588376 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.160738 Aug 30 02:14:07.683527 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 563/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:07 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:08.703334 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:08.703960 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:08.716044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:08.716562 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:08.717012 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:08.717771 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:08.718266 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:08.718678 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:08.853252 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:08.861817 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f66e662a-7a1e-499e-9dc4-06a880d9efe4 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.162332 Aug 30 02:14:08.862375 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 548/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:08 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:09.884863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:09.884863 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:09.890377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:09.890928 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:09.891445 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:09.892213 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:09.892778 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:09.893297 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:10.035864 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:10.044785 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-73fa77f7-39e1-4776-a729-ded23c5a6b0c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.166762 Aug 30 02:14:10.045507 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 564/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:09 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:11.065824 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:11.066466 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:11.072689 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:11.073168 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:11.074154 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:11.074881 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:11.075300 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:11.075721 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:11.207467 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:11.216606 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7076bbc9-61e1-49f9-bfdb-f4fe36a6268f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.155084 Aug 30 02:14:11.217248 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 549/1113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:11 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:12.237230 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:12.237897 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:12.244241 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:12.244658 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:12.245099 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:12.245846 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:12.246433 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:12.246865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:12.394072 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:12.402640 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-68b62b5f-acc1-4210-8362-909e57ed5a72 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.169439 Aug 30 02:14:12.403238 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 565/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:12 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:12.626394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-2c89ffaa-ac58-4b05-b72f-f4a3d820232e req-28a3be82-39a9-46e9-9e29-9575a099c84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a9a828-0b3a-42a1-b60b-a69e4deba7ae", "name": "network-vif-plugged", "status": "completed", "tag": "f424f2ec-8140-4609-be8e-5ad9935b214e"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:14:12.636594 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2c89ffaa-ac58-4b05-b72f-f4a3d820232e req-28a3be82-39a9-46e9-9e29-9575a099c84d service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:12.637107 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2c89ffaa-ac58-4b05-b72f-f4a3d820232e req-28a3be82-39a9-46e9-9e29-9575a099c84d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:12.637553 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-2c89ffaa-ac58-4b05-b72f-f4a3d820232e req-28a3be82-39a9-46e9-9e29-9575a099c84d service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:12.648504 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-2c89ffaa-ac58-4b05-b72f-f4a3d820232e req-28a3be82-39a9-46e9-9e29-9575a099c84d service nova] Creating event network-vif-plugged:f424f2ec-8140-4609-be8e-5ad9935b214e for instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae on hv-cinder-81966 Aug 30 02:14:12.655561 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-2c89ffaa-ac58-4b05-b72f-f4a3d820232e req-28a3be82-39a9-46e9-9e29-9575a099c84d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170385 Aug 30 02:14:12.656513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 550/1115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:14:13.424165 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:13.424712 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:13.431117 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:13.431611 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:13.432045 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:13.433168 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:13.433720 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:13.434153 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:13.569257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:13.577550 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4999c797-5457-4482-af6e-57998ef1fbc1 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1266 microversion: 2.1 time: 0.157311 Aug 30 02:14:13.578110 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 566/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:13 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:14:14.599733 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:14.600482 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:14.607217 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:14.607708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:14.608145 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:14.608852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:14.609635 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:14.610063 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:14.749501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:14.757139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-66f8c724-592c-4d13-8014-2edeaa730084 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1452 microversion: 2.1 time: 0.162292 Aug 30 02:14:14.757752 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 551/1117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:14 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:14:14.778882 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:14:14.779500 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:14:14.786079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:14.786572 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:14.787009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:14.787709 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:14.788171 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:14.788598 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:14.925341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:14:14.933877 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-b5c2d4cb-810e-4157-b411-97b1cefd99e9 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1452 microversion: 2.1 time: 0.159190 Aug 30 02:14:14.934462 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 567/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:14:14 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 02:14:17.174338 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-154c8df2-5351-4085-b574-6d5dd1c41079 req-c235a7ce-9285-48a2-95b8-3737b12de311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a9a828-0b3a-42a1-b60b-a69e4deba7ae", "tag": "f424f2ec-8140-4609-be8e-5ad9935b214e"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:14:17.184439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-154c8df2-5351-4085-b574-6d5dd1c41079 req-c235a7ce-9285-48a2-95b8-3737b12de311 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:14:17.184921 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-154c8df2-5351-4085-b574-6d5dd1c41079 req-c235a7ce-9285-48a2-95b8-3737b12de311 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:14:17.185431 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-154c8df2-5351-4085-b574-6d5dd1c41079 req-c235a7ce-9285-48a2-95b8-3737b12de311 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:14:17.197116 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-154c8df2-5351-4085-b574-6d5dd1c41079 req-c235a7ce-9285-48a2-95b8-3737b12de311 service nova] Creating event network-changed:f424f2ec-8140-4609-be8e-5ad9935b214e for instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae on hv-cinder-81966 Aug 30 02:14:17.203695 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-154c8df2-5351-4085-b574-6d5dd1c41079 req-c235a7ce-9285-48a2-95b8-3737b12de311 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033142 Aug 30 02:14:17.204313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 552/1119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:15:54.200794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:15:54.201576 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:15:54.202695 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 02:15:54.202839 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Tue Aug 30 02:15:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Aug 30 02:15:54.206921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1364750740", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1822245242", "security_groups": [{"name": "tempest-secgroup-smoke-1411314915"}], "block_device_mapping_v2": [{"uuid": "d5ba5d27-f0c2-49fa-9005-d8a86d7d16a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b43df500-c05c-42ca-b288-93458deb45ab"}]}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:15:54.322626 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.network.neutron [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] validate_networks() for [('b43df500-c05c-42ca-b288-93458deb45ab', None, None, None, None, None)] {{(pid=121094) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 02:15:54.797348 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Flavor limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 02:15:54.797796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Image limits 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 02:15:54.798284 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Flavor pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 02:15:54.798686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Image pref 0:0:0 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 02:15:54.799089 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.virt.hardware [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121094) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 02:15:54.807988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:54.808464 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:54.808894 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:54.809717 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:54.810172 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:54.810589 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:54.827439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for project fa2e7ced1148461faedcd0e1856bae95. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 02:15:54.831373 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.quota [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Getting quotas for user 40e0086c1b924e7f86bd814bb45be3d9 and project fa2e7ced1148461faedcd0e1856bae95. Resources: {'ram', 'instances', 'cores'} {{(pid=121094) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 02:15:54.891187 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Going to run 1 instances... {{(pid=121094) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 02:15:54.893267 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5ba5d27-f0c2-49fa-9005-d8a86d7d16a5',volume_size=None,volume_type=None)] {{(pid=121094) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 02:15:55.267612 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-86b3fced-452b-4495-bf66-b02a8266d7ff tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.068410 Aug 30 02:15:55.268563 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 568/1120] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 02:15:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 02:15:55.277908 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:15:55.278766 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=84 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:15:55.284139 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2c851287-f3eb-4293-b340-9e974e8b97f7 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:15:55.284834 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-2c851287-f3eb-4293-b340-9e974e8b97f7 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:15:55.338877 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-2c851287-f3eb-4293-b340-9e974e8b97f7 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:15:55.348079 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2c851287-f3eb-4293-b340-9e974e8b97f7 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1095 microversion: 2.1 time: 0.072529 Aug 30 02:15:55.348641 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 553/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:15:55 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:15:56.369887 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:15:56.370693 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:15:56.376898 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:56.377378 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:56.377833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:56.378522 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:56.378971 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:56.379388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:56.443298 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:15:56.452524 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f094b579-17e0-41d8-8c17-9fb188e3886e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1145 microversion: 2.1 time: 0.087345 Aug 30 02:15:56.452955 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 569/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:15:56 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:15:57.474164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:15:57.474790 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:15:57.481992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:57.482480 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:57.482916 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:57.483615 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:57.484261 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:57.484867 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:57.559805 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:15:57.583767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-71a2798c-bc5b-41cb-9b9b-c06e01bac14e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1211 microversion: 2.1 time: 0.099898 Aug 30 02:15:57.583767 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 554/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:15:57 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:15:58.591079 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:15:58.591686 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:15:58.598094 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:58.598571 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:58.599003 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:58.599691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:58.600184 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:58.600603 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:58.733739 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:15:58.742311 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-7380983f-48af-4461-b582-5bc702cda5ee tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1279 microversion: 2.1 time: 0.155762 Aug 30 02:15:58.743009 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 570/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:15:58 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:15:58.938713 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-8bc8ec21-bdf5-48e4-ae17-98d3aca2ab0b req-f099f87b-cd7b-4f46-8273-b806adccfccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72c363f-c3da-4a52-bbfd-89818728000a", "tag": "a01fb17f-9dda-4a60-8ad1-416ce939b551"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:15:58.948760 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-8bc8ec21-bdf5-48e4-ae17-98d3aca2ab0b req-f099f87b-cd7b-4f46-8273-b806adccfccc service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:58.951044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-8bc8ec21-bdf5-48e4-ae17-98d3aca2ab0b req-f099f87b-cd7b-4f46-8273-b806adccfccc service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:58.951044 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-8bc8ec21-bdf5-48e4-ae17-98d3aca2ab0b req-f099f87b-cd7b-4f46-8273-b806adccfccc service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:58.960677 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-8bc8ec21-bdf5-48e4-ae17-98d3aca2ab0b req-f099f87b-cd7b-4f46-8273-b806adccfccc service nova] Creating event network-changed:a01fb17f-9dda-4a60-8ad1-416ce939b551 for instance d72c363f-c3da-4a52-bbfd-89818728000a on hv-cinder-81966 Aug 30 02:15:58.966618 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-8bc8ec21-bdf5-48e4-ae17-98d3aca2ab0b req-f099f87b-cd7b-4f46-8273-b806adccfccc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033074 Aug 30 02:15:58.967406 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 555/1125] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:15:59.766377 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:15:59.767005 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:15:59.773435 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:59.775988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:59.775988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:59.775988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:15:59.775988 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:15:59.776388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:15:59.905325 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:15:59.912905 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-27dc693c-5bb1-4107-8a69-fb82fdb52cdd tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.150453 Aug 30 02:15:59.913486 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 571/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:15:59 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:00.934876 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:00.935563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:00.942117 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:00.942595 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:00.943025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:00.943708 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:00.944155 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:00.944573 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:01.076737 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:01.084781 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7ebda023-99cc-4b1c-9190-c6ef6e497bd3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.154363 Aug 30 02:16:01.085345 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 556/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:00 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:02.105707 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:02.106310 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:02.112926 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:02.113404 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:02.113875 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:02.114559 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:02.115038 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:02.115453 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:02.249388 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:02.257095 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-396aa2e9-860b-4752-b21b-eebf7fac13c3 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.155792 Aug 30 02:16:02.257699 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 572/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:02 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:03.277896 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:03.278492 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:03.284850 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:03.285325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:03.285797 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:03.286476 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:03.286929 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:03.287344 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:03.419785 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:03.427435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ded95f85-15cf-4e1c-b137-24ecafcad019 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.153544 Aug 30 02:16:03.428013 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 557/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:03 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:04.448666 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:04.449259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:04.455671 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:04.456142 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:04.456565 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:04.457244 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:04.457715 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:04.458134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:04.585134 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:04.593502 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-878224c2-2e32-451f-81a7-694efcc65101 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.149499 Aug 30 02:16:04.594076 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 573/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:04 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:05.614552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:05.615159 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:05.617704 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell0:SELECT=2 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:16:05.622543 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:05.623076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:05.623513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:05.624204 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:05.624658 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:05.625080 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:05.759041 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:05.766715 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-660132a2-e070-4ee9-8a33-66f6a574cf36 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.156277 Aug 30 02:16:05.767274 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 558/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:05 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:06.788474 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=2 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:16:06.789232 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell0:SELECT=6 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:16:06.905670 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:06.906372 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:06.912249 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:06.912734 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:06.913167 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:06.913885 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:06.914341 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:06.914975 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:07.048055 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:07.055829 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6cc911ef-c1df-45a9-ba47-fa9bc691ef17 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.271955 Aug 30 02:16:07.056391 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 574/1132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:06 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:08.076572 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:08.077177 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:08.083325 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:08.086937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:08.086937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:08.086937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:08.086937 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:08.087398 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:08.218326 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:08.225863 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-de134c0a-5558-4d0f-bd37-aa1868f6cdba tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.153237 Aug 30 02:16:08.226429 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 559/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:08 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:09.084406 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [req-cbbef92b-521e-424f-b858-78c15c2b2090 req-4eb957de-4f76-4489-b698-e6bccc598571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72c363f-c3da-4a52-bbfd-89818728000a", "name": "network-vif-plugged", "status": "completed", "tag": "a01fb17f-9dda-4a60-8ad1-416ce939b551"}]} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:16:09.095029 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-cbbef92b-521e-424f-b858-78c15c2b2090 req-4eb957de-4f76-4489-b698-e6bccc598571 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:09.095513 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-cbbef92b-521e-424f-b858-78c15c2b2090 req-4eb957de-4f76-4489-b698-e6bccc598571 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:09.095940 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [req-cbbef92b-521e-424f-b858-78c15c2b2090 req-4eb957de-4f76-4489-b698-e6bccc598571 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:09.108434 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.compute.server_external_events [req-cbbef92b-521e-424f-b858-78c15c2b2090 req-4eb957de-4f76-4489-b698-e6bccc598571 service nova] Creating event network-vif-plugged:a01fb17f-9dda-4a60-8ad1-416ce939b551 for instance d72c363f-c3da-4a52-bbfd-89818728000a on hv-cinder-81966 Aug 30 02:16:09.114706 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [req-cbbef92b-521e-424f-b858-78c15c2b2090 req-4eb957de-4f76-4489-b698-e6bccc598571 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033625 Aug 30 02:16:09.115784 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 575/1134] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:16:09.247574 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:09.248394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:09.254952 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:09.255437 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:09.255873 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:09.256568 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:09.257025 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:09.257450 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:09.388657 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:09.396452 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ab1fd16d-b9d8-4834-8ba6-3267488df42f tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.153585 Aug 30 02:16:09.397024 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 560/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:09 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:10.419339 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:10.420090 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:10.427120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:10.427607 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:10.428040 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:10.428743 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:10.429239 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:10.429691 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:10.567984 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:10.577509 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f1a1e737-9cb1-49de-aeca-c4d8f51b9123 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1267 microversion: 2.1 time: 0.163448 Aug 30 02:16:10.583266 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 576/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:10 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:11.598852 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:11.599487 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:11.606360 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:11.606842 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:11.607281 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:11.607975 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:11.608439 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:11.608865 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:11.747970 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:11.755661 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-106038d6-891d-401a-a836-ab39e54d844d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1453 microversion: 2.1 time: 0.160702 Aug 30 02:16:11.756225 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 561/1137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:11 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:11.775794 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:16:11.776472 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:16:11.782865 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:11.783345 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:11.783772 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:11.784637 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:11.785088 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:11.785538 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:11.917181 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:16:11.924886 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-79f82c64-9b0b-42e5-80fa-1e61e0ffc792 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1453 microversion: 2.1 time: 0.152921 Aug 30 02:16:11.925477 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 577/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:16:11 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:16:13.836359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-6e51e5e4-fd63-4830-ac08-d730a3d503e2 req-4affc3f7-3610-49b8-b8c0-78ddc69b6b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72c363f-c3da-4a52-bbfd-89818728000a", "tag": "a01fb17f-9dda-4a60-8ad1-416ce939b551"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:16:13.846051 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-6e51e5e4-fd63-4830-ac08-d730a3d503e2 req-4affc3f7-3610-49b8-b8c0-78ddc69b6b87 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:16:13.846528 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-6e51e5e4-fd63-4830-ac08-d730a3d503e2 req-4affc3f7-3610-49b8-b8c0-78ddc69b6b87 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:16:13.846986 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-6e51e5e4-fd63-4830-ac08-d730a3d503e2 req-4affc3f7-3610-49b8-b8c0-78ddc69b6b87 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:16:13.858394 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-6e51e5e4-fd63-4830-ac08-d730a3d503e2 req-4affc3f7-3610-49b8-b8c0-78ddc69b6b87 service nova] Creating event network-changed:a01fb17f-9dda-4a60-8ad1-416ce939b551 for instance d72c363f-c3da-4a52-bbfd-89818728000a on hv-cinder-81966 Aug 30 02:16:13.863738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-6e51e5e4-fd63-4830-ac08-d730a3d503e2 req-4affc3f7-3610-49b8-b8c0-78ddc69b6b87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030939 Aug 30 02:16:13.864329 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 562/1139] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:17:53.575672 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:17:53.576852 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG dbcounter [-] [121094] Writing DB stats nova_cell1:SELECT=52 {{(pid=121094) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:17:53.578313 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_api:SELECT=22 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:17:53.581563 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG dbcounter [-] [121093] Writing DB stats nova_cell1:SELECT=46 {{(pid=121093) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 02:17:53.582523 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:17:53.583036 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:17:53.585369 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-ba02d916-6c4b-463f-8905-1edc234c76c7 req-b09161ed-70fc-467d-ba49-dc4709826ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d72c363f-c3da-4a52-bbfd-89818728000a", "tag": "a01fb17f-9dda-4a60-8ad1-416ce939b551"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:17:53.589581 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:53.590062 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:53.590488 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:53.591921 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:53.592494 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:53.593197 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:53.596146 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-ba02d916-6c4b-463f-8905-1edc234c76c7 req-b09161ed-70fc-467d-ba49-dc4709826ab6 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:53.596687 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-ba02d916-6c4b-463f-8905-1edc234c76c7 req-b09161ed-70fc-467d-ba49-dc4709826ab6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:53.597186 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-ba02d916-6c4b-463f-8905-1edc234c76c7 req-b09161ed-70fc-467d-ba49-dc4709826ab6 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:53.610120 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-ba02d916-6c4b-463f-8905-1edc234c76c7 req-b09161ed-70fc-467d-ba49-dc4709826ab6 service nova] Creating event network-changed:a01fb17f-9dda-4a60-8ad1-416ce939b551 for instance d72c363f-c3da-4a52-bbfd-89818728000a on hv-cinder-81966 Aug 30 02:17:53.615738 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-ba02d916-6c4b-463f-8905-1edc234c76c7 req-b09161ed-70fc-467d-ba49-dc4709826ab6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039934 Aug 30 02:17:53.616552 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 563/1140] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:17:53.623842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:17:53.955053 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-bc1b1447-2b2b-406c-af78-3686c91a2867 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 204 len: 0 microversion: 2.1 time: 0.381430 Aug 30 02:17:53.958737 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 578/1141] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:17:53 2022] DELETE /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:17:53.968413 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:17:53.969175 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:17:53.976510 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:53.976992 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:53.977419 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:53.978133 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:53.978579 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:53.978994 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:54.183115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:17:54.191608 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-12915c7f-edd0-466f-b87b-c9955b8da24b tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1577 microversion: 2.1 time: 0.228372 Aug 30 02:17:54.192185 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 564/1142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:17:53 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:17:55.213649 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:17:55.214355 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:17:55.221761 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:55.222248 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:55.222684 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:55.223375 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:55.223830 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:55.224259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:55.410721 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:17:55.418619 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-ddf59036-f736-4082-abc6-a92ca642d09e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1577 microversion: 2.1 time: 0.209219 Aug 30 02:17:55.419203 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 579/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:17:55 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1577 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:17:55.983868 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-446ecad6-f954-4fc8-8455-51d6dd20ee7d req-790db61a-a505-4095-85d6-db0c9e0347d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d72c363f-c3da-4a52-bbfd-89818728000a", "name": "network-vif-deleted", "tag": "a01fb17f-9dda-4a60-8ad1-416ce939b551"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:17:55.993835 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-446ecad6-f954-4fc8-8455-51d6dd20ee7d req-790db61a-a505-4095-85d6-db0c9e0347d0 service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:55.994305 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-446ecad6-f954-4fc8-8455-51d6dd20ee7d req-790db61a-a505-4095-85d6-db0c9e0347d0 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:55.994729 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-446ecad6-f954-4fc8-8455-51d6dd20ee7d req-790db61a-a505-4095-85d6-db0c9e0347d0 service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:56.006542 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-446ecad6-f954-4fc8-8455-51d6dd20ee7d req-790db61a-a505-4095-85d6-db0c9e0347d0 service nova] Creating event network-vif-deleted:a01fb17f-9dda-4a60-8ad1-416ce939b551 for instance d72c363f-c3da-4a52-bbfd-89818728000a on hv-cinder-81966 Aug 30 02:17:56.011417 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-446ecad6-f954-4fc8-8455-51d6dd20ee7d req-790db61a-a505-4095-85d6-db0c9e0347d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Aug 30 02:17:56.011996 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 565/1144] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:17:56.439833 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:17:56.440428 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:17:56.446944 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:56.447428 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:56.447862 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:56.448561 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:56.449020 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:56.449439 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:56.511257 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:17:56.519113 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3a285fa7-c864-400f-9438-44150a9d7102 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 200 len: 1226 microversion: 2.1 time: 0.083320 Aug 30 02:17:56.519677 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 580/1145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:17:56 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:17:57.540555 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:17:57.541260 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: d72c363f-c3da-4a52-bbfd-89818728000a] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:17:57.548165 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:57.548641 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:57.549073 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:57.549793 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:17:57.550249 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:17:57.550668 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:17:57.564180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] HTTP exception thrown: Instance d72c363f-c3da-4a52-bbfd-89818728000a could not be found. Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Request method failure captured: Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a HTTP/1.1 Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXGyZZKgcA_fo0az3AGk2kAL-TGoHlkrFPmmtxn_yZdB4zdVyGRXq7xxte61x8q5DzUuWdzP6OzDnx53jcHai8Ip4VTt7VylyT1o7LJB27_09Fcm0EjjNlXE0h3RVAvMVtebJfKNtAG0z0ctocJ34IB5Va2PfgftAez2eyXNtR00NBs Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:17:57.565813 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 40e0086c1b924e7f86bd814bb45be3d9 Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance d72c363f-c3da-4a52-bbfd-89818728000a could not be found. Aug 30 02:17:57.567647 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'd72c363f-c3da-4a52-bbfd-89818728000a'} Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d72c363f-c3da-4a52-bbfd-89818728000a could not be found. Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:17:57.568724 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d72c363f-c3da-4a52-bbfd-89818728000a could not be found. Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d72c363f-c3da-4a52-bbfd-89818728000a could not be found. Aug 30 02:17:57.570412 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:17:57.572033 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Returning 404 to user: Instance d72c363f-c3da-4a52-bbfd-89818728000a could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:17:57.572033 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-f3f10db6-b9ae-48fe-9819-5d63773ed35a tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a" status: 404 len: 111 microversion: 2.1 time: 0.031306 Aug 30 02:17:57.572033 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 566/1146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:17:57 2022] GET /compute/v2.1/servers/d72c363f-c3da-4a52-bbfd-89818728000a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:18:00.852179 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:00.852687 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:00.854501 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-cc5086f7-f234-4ba6-aac0-4287bba1c141 req-14692177-9799-4d84-ac31-9f7faa11216f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a9a828-0b3a-42a1-b60b-a69e4deba7ae", "tag": "f424f2ec-8140-4609-be8e-5ad9935b214e"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:18:00.860119 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:00.860604 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:00.866796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:00.866796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:00.866796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:00.866796 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:00.867147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cc5086f7-f234-4ba6-aac0-4287bba1c141 req-14692177-9799-4d84-ac31-9f7faa11216f service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:00.867147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cc5086f7-f234-4ba6-aac0-4287bba1c141 req-14692177-9799-4d84-ac31-9f7faa11216f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:00.867147 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-cc5086f7-f234-4ba6-aac0-4287bba1c141 req-14692177-9799-4d84-ac31-9f7faa11216f service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:00.878164 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-cc5086f7-f234-4ba6-aac0-4287bba1c141 req-14692177-9799-4d84-ac31-9f7faa11216f service nova] Creating event network-changed:f424f2ec-8140-4609-be8e-5ad9935b214e for instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae on hv-cinder-81966 Aug 30 02:18:00.883953 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-cc5086f7-f234-4ba6-aac0-4287bba1c141 req-14692177-9799-4d84-ac31-9f7faa11216f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033073 Aug 30 02:18:00.884749 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 567/1147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 02:18:00.892177 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Going to try to terminate instance {{(pid=121094) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 02:18:01.288818 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-5b2a6749-8dc7-4d54-a993-3733ad4c1a5c tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 204 len: 0 microversion: 2.1 time: 0.439767 Aug 30 02:18:01.289804 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 581/1148] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:18:00 2022] DELETE /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 02:18:01.299373 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:01.300406 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:01.306688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:01.307173 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:01.307610 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:01.308309 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:01.308760 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:01.309383 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:01.446845 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.policy [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121093) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:18:01.455741 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-e62b7833-8d1c-4b08-b50b-4af09a17d11e tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1577 microversion: 2.1 time: 0.161486 Aug 30 02:18:01.456306 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 568/1149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:18:01 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:18:02.489635 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:02.490256 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:02.497650 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:02.498140 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:02.498568 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:02.500324 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:02.500894 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:02.501318 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:02.631770 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:18:02.640001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-95e59c30-a5b6-4dce-9947-6fe6e2fb1cfa tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1458 microversion: 2.1 time: 0.154747 Aug 30 02:18:02.640708 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 582/1150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:18:02 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:18:03.273662 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [req-de7d3122-d43a-4933-86b2-931420a2a0db req-12b7f87f-baf6-4ed2-95d8-d1026eb687ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a9a828-0b3a-42a1-b60b-a69e4deba7ae", "name": "network-vif-deleted", "tag": "f424f2ec-8140-4609-be8e-5ad9935b214e"}]} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 02:18:03.283851 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-de7d3122-d43a-4933-86b2-931420a2a0db req-12b7f87f-baf6-4ed2-95d8-d1026eb687ec service nova] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:03.289341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-de7d3122-d43a-4933-86b2-931420a2a0db req-12b7f87f-baf6-4ed2-95d8-d1026eb687ec service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:03.289341 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [req-de7d3122-d43a-4933-86b2-931420a2a0db req-12b7f87f-baf6-4ed2-95d8-d1026eb687ec service nova] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:03.297076 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.compute.server_external_events [req-de7d3122-d43a-4933-86b2-931420a2a0db req-12b7f87f-baf6-4ed2-95d8-d1026eb687ec service nova] Creating event network-vif-deleted:f424f2ec-8140-4609-be8e-5ad9935b214e for instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae on hv-cinder-81966 Aug 30 02:18:03.302500 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [req-de7d3122-d43a-4933-86b2-931420a2a0db req-12b7f87f-baf6-4ed2-95d8-d1026eb687ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Aug 30 02:18:03.303075 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 569/1151] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 02:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 02:18:03.661174 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:03.661992 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:03.668841 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:03.669328 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:03.669801 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:03.670511 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:03.670964 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:03.672001 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:03.741105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.policy [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40e0086c1b924e7f86bd814bb45be3d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e7ced1148461faedcd0e1856bae95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121094) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 02:18:03.749105 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-296ed770-a7f5-40c7-be5d-eb01c15a8586 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 200 len: 1225 microversion: 2.1 time: 0.092070 Aug 30 02:18:03.749895 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 583/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:18:03 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 02:18:04.771030 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:04.771720 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: 08a9a828-0b3a-42a1-b60b-a69e4deba7ae] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:04.778528 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:04.779005 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:04.779435 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:04.780115 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:04.781180 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:04.781628 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:04.794895 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] HTTP exception thrown: Instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae could not be found. Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Request method failure captured: Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae HTTP/1.1 Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXGyZZKgcA_fo0az3AGk2kAL-TGoHlkrFPmmtxn_yZdB4zdVyGRXq7xxte61x8q5DzUuWdzP6OzDnx53jcHai8Ip4VTt7VylyT1o7LJB27_09Fcm0EjjNlXE0h3RVAvMVtebJfKNtAG0z0ctocJ34IB5Va2PfgftAez2eyXNtR00NBs Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:18:04.796745 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 40e0086c1b924e7f86bd814bb45be3d9 Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae could not be found. Aug 30 02:18:04.798523 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': '08a9a828-0b3a-42a1-b60b-a69e4deba7ae'} Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae could not be found. Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:18:04.799533 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae could not be found. Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae could not be found. Aug 30 02:18:04.801127 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:04.802846 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Returning 404 to user: Instance 08a9a828-0b3a-42a1-b60b-a69e4deba7ae could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:18:04.802846 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-28e2d7c8-9ca0-4a8b-aef5-aaaf22c737dc tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae" status: 404 len: 111 microversion: 2.1 time: 0.031491 Aug 30 02:18:04.802846 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 570/1153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:18:04 2022] GET /compute/v2.1/servers/08a9a828-0b3a-42a1-b60b-a69e4deba7ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:18:05.335308 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:05.335817 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.compute.api [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121094) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:05.342351 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:05.342896 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:05.343442 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:05.344135 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:05.344585 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:05.345004 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:05.359034 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] HTTP exception thrown: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Request method failure captured: Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: request: DELETE /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 HTTP/1.1 Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept: application/json Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Accept-Encoding: identity Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Connection: close Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Length: 0 Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Content-Type: application/json Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Host: 10.222.0.27 Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: Openstack-System-Scope: None Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: User-Agent: python-urllib3/1.26.12 Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Auth-Token: gAAAAABjDXGyZZKgcA_fo0az3AGk2kAL-TGoHlkrFPmmtxn_yZdB4zdVyGRXq7xxte61x8q5DzUuWdzP6OzDnx53jcHai8Ip4VTt7VylyT1o7LJB27_09Fcm0EjjNlXE0h3RVAvMVtebJfKNtAG0z0ctocJ34IB5Va2PfgftAez2eyXNtR00NBs Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Id: None Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Domain-Name: None Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Identity-Status: Confirmed Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Is-Admin-Project: True Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Id: default Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Domain-Name: Default Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Project-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Role: reader,member Aug 30 02:18:05.360752 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Roles: reader,member Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-Tenant-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Id: default Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Domain-Name: Default Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Id: 40e0086c1b924e7f86bd814bb45be3d9 Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: X-User-Name: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: method: > Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: exception: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.362842 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: action_args: {'id': 'a1130974-c6cb-4808-9dce-76f961f71ac6'} Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:18:05.364002 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.365595 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.367259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Returning 404 to user: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:18:05.367259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-6e75397b-ded3-4f30-97fb-72a61ef86437 tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 404 len: 111 microversion: 2.1 time: 0.030999 Aug 30 02:18:05.367259 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 584/1154] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 02:18:05 2022] DELETE /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:18:05.371050 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:05.371663 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.compute.api [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] [instance: a1130974-c6cb-4808-9dce-76f961f71ac6] Fetching instance by UUID {{(pid=121093) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 02:18:05.378470 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:05.379085 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:05.379513 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:05.380198 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Acquiring lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 02:18:05.380643 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 02:18:05.381060 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Lock "f5299b58-fdcd-461c-bb89-e110eb2a6931" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 02:18:05.394359 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] HTTP exception thrown: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Request method failure captured: Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: request: GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 HTTP/1.1 Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept: application/json Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Accept-Encoding: identity Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Connection: close Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Length: 0 Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Content-Type: application/json Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Host: 10.222.0.27 Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: Openstack-System-Scope: None Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: User-Agent: python-urllib3/1.26.12 Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Auth-Token: gAAAAABjDXGyZZKgcA_fo0az3AGk2kAL-TGoHlkrFPmmtxn_yZdB4zdVyGRXq7xxte61x8q5DzUuWdzP6OzDnx53jcHai8Ip4VTt7VylyT1o7LJB27_09Fcm0EjjNlXE0h3RVAvMVtebJfKNtAG0z0ctocJ34IB5Va2PfgftAez2eyXNtR00NBs Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Id: None Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Domain-Name: None Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Identity-Status: Confirmed Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Is-Admin-Project: True Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Id: default Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Domain-Name: Default Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Project-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Role: reader,member Aug 30 02:18:05.395853 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Roles: reader,member Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fa2e7ced1148461faedcd0e1856bae95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}] Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Id: fa2e7ced1148461faedcd0e1856bae95 Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-Tenant-Name: tempest-TestVolumeBootPattern-1845229691 Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Id: default Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Domain-Name: Default Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Id: 40e0086c1b924e7f86bd814bb45be3d9 Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: X-User-Name: tempest-TestVolumeBootPattern-1845229691-project Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: method: > Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: exception: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.397584 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: action_args: {'id': 'a1130974-c6cb-4808-9dce-76f961f71ac6'} Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 02:18:05.398688 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. Aug 30 02:18:05.400336 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: ERROR nova.api.openstack.wsgi Aug 30 02:18:05.401869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Returning 404 to user: Instance a1130974-c6cb-4808-9dce-76f961f71ac6 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 02:18:05.401869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-8e457d1f-8a4c-4f12-a562-b2ead97659fe tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6" status: 404 len: 111 microversion: 2.1 time: 0.030054 Aug 30 02:18:05.401869 dv-cinder-819667-6-iscsi devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 571/1155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 02:18:05 2022] GET /compute/v2.1/servers/a1130974-c6cb-4808-9dce-76f961f71ac6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 02:18:06.899120 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-8f4c53da-6f67-4cc6-8862-c53efe0ac20d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] Calling method '.version_select at 0x7f4736435820>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 02:18:06.972415 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-8f4c53da-6f67-4cc6-8862-c53efe0ac20d tempest-TestVolumeBootPattern-1845229691 tempest-TestVolumeBootPattern-1845229691-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1822245242" status: 202 len: 0 microversion: 2.1 time: 0.081043 Aug 30 02:18:06.972991 dv-cinder-819667-6-iscsi devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 585/1156] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 02:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1822245242 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)